-- Logs begin at Tue 2021-11-23 07:03:19 UTC, end at Tue 2021-11-23 08:01:41 UTC. -- Nov 23 07:34:32.768579 dv-cinder-804035-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 23 07:34:32.777212 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 23 07:34:32.779202 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 23 07:34:32 2021] *** Nov 23 07:34:32.779202 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 23 07:34:32.779202 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 23 07:34:32.779202 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: nodename: dv-cinder-804035-14-iscsi Nov 23 07:34:32.779202 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: machine: x86_64 Nov 23 07:34:32.779202 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: clock source: unix Nov 23 07:34:32.779202 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: pcre jit disabled Nov 23 07:34:32.779202 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: detected number of CPU cores: 4 Nov 23 07:34:32.779202 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: current working directory: / Nov 23 07:34:32.779202 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: detected binary path: /usr/bin/uwsgi-core Nov 23 07:34:32.779928 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: your processes number limit is 47680 Nov 23 07:34:32.779928 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: your memory page size is 4096 bytes Nov 23 07:34:32.779928 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: detected max file descriptor number: 2048 Nov 23 07:34:32.779928 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: lock engine: pthread robust mutexes Nov 23 07:34:32.779928 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: thunder lock: enabled Nov 23 07:34:32.779928 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 23 07:34:32.779928 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 23 07:34:32.823925 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: Python main interpreter initialized at 0x558939f389c0 Nov 23 07:34:32.823925 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: python threads support enabled Nov 23 07:34:32.823925 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: your server socket listen backlog is limited to 100 connections Nov 23 07:34:32.823925 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: your mercy for graceful operations on workers is 90 seconds Nov 23 07:34:32.824316 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: mapped 403077 bytes (393 KB) for 2 cores Nov 23 07:34:32.824390 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: *** Operational MODE: preforking *** Nov 23 07:34:32.824633 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: *** uWSGI is running in multiple interpreter mode *** Nov 23 07:34:32.824633 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: spawned uWSGI master process (pid: 108590) Nov 23 07:34:32.824842 dv-cinder-804035-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 23 07:34:32.825960 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: spawned uWSGI worker 1 (pid: 108591, cores: 1) Nov 23 07:34:32.825960 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: spawned uWSGI worker 2 (pid: 108592, cores: 1) Nov 23 07:34:32.825960 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 23 07:34:34.432827 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 07:34:34.432827 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: from cryptography.utils import int_from_bytes Nov 23 07:34:34.433463 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 07:34:34.433463 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: from cryptography.utils import int_from_bytes Nov 23 07:34:34.433928 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 07:34:34.433928 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: from cryptography.utils import int_from_bytes Nov 23 07:34:34.434056 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 07:34:34.434056 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: from cryptography.utils import int_from_bytes Nov 23 07:34:36.924496 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 07:34:36.925040 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 07:34:36.925385 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 07:34:36.925498 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 07:34:36.925597 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 07:34:36.925686 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 07:34:36.925796 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 07:34:36.925877 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 07:34:36.925954 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 07:34:36.926061 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 07:34:36.926241 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.926381 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.926567 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.926709 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.926893 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.927036 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.927216 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.927360 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.927546 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.927701 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.927858 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.928015 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.928177 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.928338 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.928503 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.928666 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.928825 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.928996 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.929104 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.929255 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.929377 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.929570 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.929714 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-14-iscsi {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.929923 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-14-iscsi {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.930045 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.930249 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.930344 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.930557 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.930645 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.930872 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.930973 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.931192 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.931307 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.931496 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.931605 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.931820 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.931921 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.932137 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.932312 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.932642 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.932744 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.932953 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.933042 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.933258 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.933348 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.933569 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.933811 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.934013 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.934184 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.934428 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.934633 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.934843 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.935013 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.935209 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.935446 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.935653 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.935850 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.936021 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.936252 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.936458 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.936675 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-14-iscsi {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.936870 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-14-iscsi {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.937079 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.937305 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.937514 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.937747 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.937944 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.938115 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.938896 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.939102 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.939268 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.939454 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.939633 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.939782 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.939918 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.940107 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.940244 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.940386 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.940530 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.940698 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.940852 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.940995 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.941137 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.941359 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.941512 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.941655 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.941846 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.942080 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.942232 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.942383 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.942519 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.942652 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.942787 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.942930 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.943065 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.943207 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.943342 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.943476 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.943609 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.943744 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.943878 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.944030 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.944166 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.944299 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.944432 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.944572 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.944767 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.944921 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.945058 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.945204 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.945343 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.945479 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.945633 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.945802 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.945952 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.946237 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.946388 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.946534 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.946679 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.946821 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.946964 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.947106 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.947245 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.947535 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.947900 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.948045 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.948181 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.948316 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.948461 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.948596 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.948738 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.948879 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.949024 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.949165 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.949310 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.949452 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.949607 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.949789 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.949938 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.950075 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.950222 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.950363 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.950498 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.950632 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.950773 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.950908 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.951051 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.951187 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.951345 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.951577 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.951719 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.951855 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.951999 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.952194 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.952341 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.952477 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.952612 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.952758 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.952894 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.953027 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.953168 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.953303 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.953447 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.953593 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.953746 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.953897 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.954092 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.954760 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.954897 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.955047 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.955183 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.955326 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.955462 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.955596 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.955745 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.955893 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.956035 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.956169 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.956395 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.956541 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.956693 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.956829 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.956963 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.957097 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.957230 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.957371 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.957514 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.957668 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.957847 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.957982 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.958125 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.958261 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.958407 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.958543 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.958676 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.958816 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.958958 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.959100 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.959247 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.959413 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.959568 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.959703 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.959842 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.959977 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.960184 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.960321 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.960462 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.960597 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.960731 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.960873 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.961009 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.961142 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.961276 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.961427 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.961585 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.961829 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.961979 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.962114 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.962257 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.962401 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.962537 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.962671 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.962816 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.962958 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.963101 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.963236 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.963386 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.963521 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.963665 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.963807 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.963942 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.964090 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.964226 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.964369 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.964504 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.964637 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.964778 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.964920 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.965072 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.965216 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.965361 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.965496 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.965635 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.965835 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.965972 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.966121 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.966257 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.966407 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.966614 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.966760 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.966897 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.967058 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.967195 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.967335 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.967476 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.967617 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.967763 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.967905 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.968048 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.968183 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.968318 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.968451 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.968593 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.968729 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.968876 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.969011 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.969144 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.969278 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.969420 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.969554 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.969799 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.969943 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.970084 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.970227 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:34:36.970371 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.970506 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.970641 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.970792 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.970928 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.971071 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.971207 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.971347 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.971482 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.971624 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.971761 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.971992 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.972135 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.972270 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.972411 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.972557 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.972692 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.972835 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.972972 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.973107 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.973242 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.973376 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.973519 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.973940 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.974076 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.974210 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.974345 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.974478 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.974633 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.974769 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.974910 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.975065 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.975217 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.975354 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.975587 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.975724 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.975866 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.976002 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.976145 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.976282 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.976436 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.976579 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.976813 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.976954 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.977089 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.977223 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.977367 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.977503 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.977643 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.977801 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.977938 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.978082 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.978226 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.978380 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.978517 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.978662 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.978805 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.978948 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.979085 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.979219 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.979353 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.979488 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.979629 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.979852 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.979997 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.980132 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.980278 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.980413 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.980555 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.980699 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.980834 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.980968 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.981102 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.981235 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.981370 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.981517 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.981659 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.981821 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.981984 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.982192 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.982343 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.982486 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.982623 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.982757 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.982891 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.983025 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.983172 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.983315 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.983450 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.983585 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.983719 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.983863 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.984005 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.984140 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.984275 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.984408 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.984542 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.984684 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.984835 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.984972 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.985113 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.985281 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.985423 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.985570 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.985782 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.985934 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.986071 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.986205 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.986338 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.986485 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.986621 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.986756 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.986976 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.987117 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.987252 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.987395 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.987538 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.987689 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.987836 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.987972 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.988106 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.988252 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.988389 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.988523 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.988657 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.988791 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.988939 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.989074 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.989208 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.989349 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.989495 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.989630 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.989836 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.989977 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.990112 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.990252 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.990393 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.990527 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.990677 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.990812 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.990954 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.991090 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.991237 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.991372 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.991519 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.991654 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.991789 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.991923 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.992058 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.992218 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.992429 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.992569 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.992717 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.992853 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.992988 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.993141 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.993278 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.993419 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.993555 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.993696 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.993860 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.994006 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.994150 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.994292 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.994437 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.994573 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.994707 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.994850 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.994995 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.995131 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.995266 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.995434 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.995587 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.995747 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.995889 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.996054 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.996198 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.996360 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.996515 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.996651 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.996793 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.997011 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.997138 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.997313 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.997421 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.997662 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.997786 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.998022 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.998124 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.998345 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.998453 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.998660 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.998750 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.998978 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.999072 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.999288 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.999402 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.999622 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.999709 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:36.999917 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.000005 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.000229 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.000326 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.000544 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.000633 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.001363 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.001463 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.001690 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.001813 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.002034 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.002131 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.002348 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.002437 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.002664 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.002752 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.002976 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.003066 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.003279 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.003382 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.003596 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.003692 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.003914 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.004006 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.004247 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.004343 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.004569 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.004672 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.004888 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.004976 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.005197 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.005293 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.005512 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.005608 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.005848 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.005939 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.006190 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.006304 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.006472 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.006557 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.006773 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.006903 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.007087 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.007182 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.007424 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.007526 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.007715 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.007810 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.008034 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.008203 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.008335 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.008445 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.008642 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.008729 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.008958 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.009046 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.009264 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.009350 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.009576 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.009663 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.009916 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.010007 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.010248 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.010336 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.010566 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.010656 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.010883 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.010980 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.011196 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.011283 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.011507 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.011602 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.011818 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.011916 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.012127 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.012220 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.012432 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.012546 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.012738 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.012826 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.013047 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.013135 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.013360 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.013455 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.013671 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.013786 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.014005 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.014105 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.014314 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.014419 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.014615 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.014705 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.014927 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.015030 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.015229 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.015326 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.015533 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.015620 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.015836 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.015923 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.016149 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.016246 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.016459 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.016652 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.017354 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.017446 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.017676 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.017778 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.018016 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.018104 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.018321 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.018409 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.018627 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.018734 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.018942 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.019040 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.019246 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.019340 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.019551 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.019654 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.019854 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.019942 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.020156 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.020256 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.020496 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.020583 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.020799 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.020894 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.021100 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.021195 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.021419 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.021515 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.021745 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.021837 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.022063 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.022164 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.022373 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.022461 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.022683 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.022764 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.022994 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.023096 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.023304 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.023392 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.023613 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.023701 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.023923 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.024011 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.024231 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.024325 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.024542 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.024629 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.024851 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.024939 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.025161 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.025324 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.025473 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.025569 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.025806 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.025897 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.026122 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.026221 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.026426 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.026514 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.026730 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.026819 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.027044 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.027139 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.027361 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.027630 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.027936 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.028024 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.028269 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.028351 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.028586 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.028681 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.028905 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.028993 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.029225 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.029318 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.029547 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.029648 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.029901 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.029988 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.030219 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.030307 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.030526 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.030623 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.030830 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.030918 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.031135 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.031222 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.031440 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.031530 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.031744 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.031832 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.032048 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.032163 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.032382 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.032471 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.032691 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.032786 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.033000 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.033087 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.033310 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.033400 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.033616 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.033723 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.033947 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.034047 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.034294 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.034389 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.034604 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.034777 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.034909 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.034998 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.035215 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.035312 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.035520 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.035609 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.035823 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.035910 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.036149 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.036238 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.036455 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.036544 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.036760 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.036853 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.037064 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.037151 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.037368 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.037464 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.037747 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.037838 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.038039 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.038139 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.038384 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.038476 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.038718 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.038807 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.039023 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.039121 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.039331 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.039420 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.039652 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.039739 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.039957 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.040053 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.040264 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.040352 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.040568 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.040655 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.040872 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.040968 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.041178 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.041273 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.041481 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.041570 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.041812 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.041904 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.042126 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.042221 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.042436 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.042531 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.042743 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.042833 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.043047 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.043136 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.043350 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.043438 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.043652 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.043741 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.043959 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.044045 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.044265 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.044352 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.044570 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.044667 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.044873 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.044961 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.045180 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.045277 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.045485 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.045580 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.045816 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.045907 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.046125 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.046226 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.046428 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.046517 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.046750 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.046940 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.047024 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.047112 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.047326 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.047415 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.047629 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.047742 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.047961 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.048059 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.048274 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.048364 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.048586 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.048674 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.048888 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.048977 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.049204 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.049293 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.049508 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.049596 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.049838 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.049930 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.050143 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.050275 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.050445 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.050544 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.050747 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.050842 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.051052 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.051147 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.051361 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.051449 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.051672 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.051761 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.051975 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.052096 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.052280 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.052399 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.052577 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.052671 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.052879 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.052966 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.053182 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.053289 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.053490 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.053602 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.053814 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.053918 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.054124 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.054221 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.054430 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.054516 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.054736 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.054826 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.055040 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.055143 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.055344 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.055433 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.055668 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.055758 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.055971 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.056060 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.056273 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.056363 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.056575 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.056663 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.056877 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.056967 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.057210 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.057300 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.057511 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.057600 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.057903 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.057993 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.058210 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.058299 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.058526 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.058632 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.058914 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.059036 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.059154 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.059245 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.059463 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.059568 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.059767 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.059862 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.060072 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.060211 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.060393 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.060553 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.060702 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.061019 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.061108 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.061325 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.061545 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.061738 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.061967 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.062120 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.062283 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.062597 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.062692 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.062919 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.063239 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.063346 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.064089 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.064324 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.064423 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.064699 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.064891 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.065012 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.065325 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.065467 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.065639 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.065978 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.066142 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.066292 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.066608 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.066697 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.066925 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.067230 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.067322 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.067543 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.067792 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.067883 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.068163 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.068354 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.068477 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.068785 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.068923 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.069128 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.069441 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.069531 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.069769 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.070061 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.070164 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.070378 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.070573 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.070694 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.071002 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.071098 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.071455 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.071560 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.071770 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.071860 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.072083 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.072179 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.072398 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.072524 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.072716 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.072847 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.073067 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.073304 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.073462 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.073623 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.073871 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.074117 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.074362 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.074609 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.074870 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.074870 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.075329 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.075574 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.075814 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.076071 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.076357 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.076357 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.076835 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.077085 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.077326 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.078550 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.078707 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.078856 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.079000 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.079755 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.079923 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.080090 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.080249 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.080411 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.080562 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.080699 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.080801 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.080885 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.080966 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.081045 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.081124 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.081204 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.081294 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.081377 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.081456 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.081535 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.081623 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.081725 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.081867 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.081958 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.082039 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.082119 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.082197 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.082291 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.082381 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.082463 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.082542 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.082542 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.082696 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.082786 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.082868 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.082937 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.083016 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.083016 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.083160 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.083252 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.083470 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.083562 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.083797 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.084118 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.084286 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.084439 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.084745 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.084834 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.085070 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.085160 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.085392 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.085555 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.085750 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.085920 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.086063 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.086244 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.086498 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.086639 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.086827 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.086924 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.087143 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.087232 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.087472 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.087563 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.087808 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.087906 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.088117 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.088251 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.088428 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.088519 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.088742 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.088837 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.089050 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.089138 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.089357 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.089457 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.089664 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.089786 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.090005 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.090094 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.090320 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.090600 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.090700 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.090931 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.091190 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.091279 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.091529 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.091794 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.091885 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.092146 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.092469 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.092599 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.092789 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.093118 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.093215 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.093441 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.093561 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.093786 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.093933 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.094095 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.094284 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.094406 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.094621 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.094743 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.094942 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.095041 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.095264 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.095354 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.095576 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.095672 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.095892 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.095983 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.096221 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.096310 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.096532 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.096631 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.096848 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.096940 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.097163 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.097259 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.097477 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.097616 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.097831 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.097924 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.098141 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.098231 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.098468 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.098810 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.099031 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.099122 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.099345 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.099478 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.099653 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.099751 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.099965 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.100054 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.100273 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.100361 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.100579 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.100676 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.100885 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.101036 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.101193 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.101282 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.101496 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.101594 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.101822 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.101913 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.102128 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.102218 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.102448 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.102545 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.102754 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.102842 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.103074 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.103164 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.103381 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.103469 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.103685 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.103812 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.103990 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.104080 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.104357 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.104455 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.104622 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.104713 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.104926 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.105026 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.105258 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.105350 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.105580 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.105693 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.105925 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.106017 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.106234 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.106325 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.106546 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.106635 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.106852 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.106955 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.107159 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.107248 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.107466 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.107554 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.107775 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.107875 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.108079 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.108171 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.108383 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.108474 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.108687 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.108787 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.109004 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.109093 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.109306 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.109394 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.109622 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.109753 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.109957 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.110046 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.110289 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.110387 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.110643 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.110951 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.111047 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.111280 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.111369 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.111586 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.111750 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.111900 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.111991 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.112216 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.112312 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.112535 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.112632 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.112849 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.112937 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.113160 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.113258 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.113473 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.113575 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.113807 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.113900 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.114121 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.114226 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.114437 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.114526 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.114755 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.114843 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.115073 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.115163 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.115391 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.115482 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.115712 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.115809 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.116020 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.116109 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.116336 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.116426 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.116651 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.116740 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.116969 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.117070 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.117334 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.117532 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.117629 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.117893 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.117999 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.118216 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.118309 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.118534 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.118623 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.118881 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.118987 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.119171 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.119261 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.119487 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.119575 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.119856 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.119965 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.120114 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.120204 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.120425 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.120513 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.120737 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.120836 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.121053 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.121141 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.121380 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.121468 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.121719 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.121829 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.122052 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.122143 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.122370 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.122466 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.122688 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.122778 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.123004 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.123098 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.123318 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.123522 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.123666 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.123842 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.123981 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.124177 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.124291 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.124505 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.124595 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.124831 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.124922 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.125154 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.125245 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.125477 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.125569 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.126328 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.126450 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.126658 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.126747 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.126969 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.127060 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.127282 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.127379 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.127592 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.127681 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.127905 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.128002 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.128221 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.128311 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.128533 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.128630 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.128841 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.128930 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.129162 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.129251 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.129474 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.129580 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.129812 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.130032 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.130122 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.130383 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.130639 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.130759 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.130959 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.131056 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.131296 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.131385 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.131625 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.131716 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.131933 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.132021 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.132257 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.132345 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.132566 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.132663 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.132874 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.132970 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.133190 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.133284 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.133500 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.133590 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.133829 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.133921 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.134139 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.134228 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.134445 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.134536 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.134754 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.134843 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.135060 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.135157 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.135367 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.135461 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.135671 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.135760 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.135994 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.136089 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.136299 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.136524 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.136614 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.136872 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.136962 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.137189 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.137279 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.137493 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.137581 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.137829 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.137923 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.138137 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.138238 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.138441 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.138534 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.138755 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.138854 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.139060 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.139149 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.139365 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.139452 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.139668 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.139768 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.139981 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.140069 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.140282 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.140378 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.140586 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.140683 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.140887 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.140975 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.141193 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.141280 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.141551 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.141660 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.141879 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.141971 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.142187 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.142278 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.142496 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.142586 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.142810 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.142905 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.143117 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.143207 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.143423 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.143513 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.143737 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.143826 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.144046 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.144142 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.144354 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.144587 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.144684 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.144951 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.145040 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.145264 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.145361 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.145568 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.145657 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.145908 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.145999 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.146216 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.146307 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.146528 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.146618 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.146832 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.146970 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.147144 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.147236 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.147448 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.147543 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.147762 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.147851 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.148065 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.148154 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.148369 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.148467 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.148676 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.148766 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.148985 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.149123 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.149292 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.149381 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.149602 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.149763 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.149937 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.150027 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.150251 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.150341 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.150591 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.150693 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.150910 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.151122 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.151212 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.151502 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.151603 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.151824 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.151914 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.152135 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.152235 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.152449 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.152548 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.152762 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.152852 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.153072 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.153160 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.153377 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.153485 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.153719 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.153812 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.154033 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.154123 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.154338 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.154439 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.154646 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.154768 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.154956 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.155084 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.155265 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.155405 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.155572 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.155731 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.155885 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.156043 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.156193 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.156365 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.156500 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.156688 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.156812 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.157002 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.157662 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.157867 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.158081 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.158171 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.158401 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.158502 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.158717 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.158808 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.159035 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.159124 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.159345 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.159442 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.159657 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.159746 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.159967 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.160055 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.160275 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.160374 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.160591 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.160680 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.160920 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.161020 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.161234 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.161332 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.161542 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.161631 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.161914 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.162004 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.162231 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.162321 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.162555 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.162643 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.162868 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.162976 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.163190 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.163281 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.163513 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.163602 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.163832 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.163921 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.164145 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.164235 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.164469 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.164558 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.164780 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.164877 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.165095 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.165185 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.165408 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.165505 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.165736 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.165851 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.166055 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.166146 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.166366 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.166455 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.166679 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.166777 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.166988 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.167082 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.167300 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.167389 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.167623 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.167720 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.167943 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.168035 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.168259 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.168348 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.168575 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.168723 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.168887 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.168988 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.169214 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.169347 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.169525 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.169622 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.169865 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.169955 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.170179 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.170271 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.170492 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.170586 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.170801 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.170891 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.171116 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.171212 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.171432 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.171520 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.171742 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.171839 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.172054 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.172157 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.172365 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.172456 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.172680 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.172847 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.173045 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.173149 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.173374 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.173465 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.173749 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.173843 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.174031 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.174122 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.174359 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.174459 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.174713 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.174817 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.174916 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 07:34:37.175000 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.175294 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.175601 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.175934 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.176247 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.176563 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.176875 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.177187 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.177504 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.177845 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.178173 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.178498 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.178823 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.179150 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.179501 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.179817 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.180163 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.180493 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.180808 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.181121 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.181427 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:34:37.181672 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 07:34:37.197820 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_db.sqlalchemy.engines [None req-820f7723-95be-4fa5-961e-26da32f93ef2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 07:34:37.204824 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG oslo_db.sqlalchemy.engines [None req-34f8dea3-262d-4d6a-b30a-396ec1e34c9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 07:34:37.266892 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.context [None req-820f7723-95be-4fa5-961e-26da32f93ef2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),00cd383d-2cfa-4558-9f64-d93e8a76ade1(cell1) {{(pid=108591) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 07:34:37.271205 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-820f7723-95be-4fa5-961e-26da32f93ef2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:34:37.271340 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.context [None req-34f8dea3-262d-4d6a-b30a-396ec1e34c9a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),00cd383d-2cfa-4558-9f64-d93e8a76ade1(cell1) {{(pid=108592) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 07:34:37.272801 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-820f7723-95be-4fa5-961e-26da32f93ef2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:34:37.273625 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-820f7723-95be-4fa5-961e-26da32f93ef2 None None] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:34:37.275534 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG oslo_concurrency.lockutils [None req-34f8dea3-262d-4d6a-b30a-396ec1e34c9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:34:37.275705 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-820f7723-95be-4fa5-961e-26da32f93ef2 None None] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:34:37.277092 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG oslo_concurrency.lockutils [None req-34f8dea3-262d-4d6a-b30a-396ec1e34c9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:34:37.277929 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG oslo_concurrency.lockutils [None req-34f8dea3-262d-4d6a-b30a-396ec1e34c9a None None] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:34:37.279876 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG oslo_concurrency.lockutils [None req-34f8dea3-262d-4d6a-b30a-396ec1e34c9a None None] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:34:37.286740 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_db.sqlalchemy.engines [None req-820f7723-95be-4fa5-961e-26da32f93ef2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 07:34:37.289476 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_db.sqlalchemy.engines [None req-820f7723-95be-4fa5-961e-26da32f93ef2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 07:34:37.293791 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG oslo_db.sqlalchemy.engines [None req-34f8dea3-262d-4d6a-b30a-396ec1e34c9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 07:34:37.299337 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG oslo_db.sqlalchemy.engines [None req-34f8dea3-262d-4d6a-b30a-396ec1e34c9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 07:34:37.550364 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_db.sqlalchemy.engines [None req-820f7723-95be-4fa5-961e-26da32f93ef2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 07:34:37.561332 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG oslo_db.sqlalchemy.engines [None req-34f8dea3-262d-4d6a-b30a-396ec1e34c9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 07:34:37.895720 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: WARNING keystonemiddleware.auth_token [None req-820f7723-95be-4fa5-961e-26da32f93ef2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 07:34:37.896925 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: WARNING keystonemiddleware.auth_token [None req-34f8dea3-262d-4d6a-b30a-396ec1e34c9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 07:34:37.902366 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: WARNING keystonemiddleware.auth_token [None req-820f7723-95be-4fa5-961e-26da32f93ef2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 07:34:37.903597 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: WARNING keystonemiddleware.auth_token [None req-34f8dea3-262d-4d6a-b30a-396ec1e34c9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 07:34:38.128084 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: WARNING keystonemiddleware.auth_token [None req-820f7723-95be-4fa5-961e-26da32f93ef2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 07:34:38.128626 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: WARNING keystonemiddleware.auth_token [None req-34f8dea3-262d-4d6a-b30a-396ec1e34c9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 07:34:38.133268 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: WARNING keystonemiddleware.auth_token [None req-820f7723-95be-4fa5-961e-26da32f93ef2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 07:34:38.133801 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: WARNING keystonemiddleware.auth_token [None req-34f8dea3-262d-4d6a-b30a-396ec1e34c9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 07:34:38.138685 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558939f389c0 pid: 108591 (default app) Nov 23 07:34:38.139074 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558939f389c0 pid: 108592 (default app) Nov 23 07:34:38.140782 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-820f7723-95be-4fa5-961e-26da32f93ef2 None None] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:34:38.142513 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-820f7723-95be-4fa5-961e-26da32f93ef2 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002316 Nov 23 07:34:38.142933 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Tue Nov 23 07:34:38 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:36:10.470603 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-34f8dea3-262d-4d6a-b30a-396ec1e34c9a None None] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:36:10.471924 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-34f8dea3-262d-4d6a-b30a-396ec1e34c9a None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002180 Nov 23 07:36:10.472399 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 930 bytes} [Tue Nov 23 07:36:10 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:36:11.080871 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-ea646fb5-225d-4769-afb5-668922cc01da admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:36:11.115006 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-ea646fb5-225d-4769-afb5-668922cc01da admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.630585 Nov 23 07:36:11.115536 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 2/3] 10.222.0.48 () {60 vars in 1291 bytes} [Tue Nov 23 07:36:10 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:36:14.360750 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-34f8dea3-262d-4d6a-b30a-396ec1e34c9a None None] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:36:14.363318 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-34f8dea3-262d-4d6a-b30a-396ec1e34c9a None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Nov 23 07:36:14.365678 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 2/4] 10.222.0.48 () {54 vars in 930 bytes} [Tue Nov 23 07:36:14 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:36:14.435115 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-548e34e5-a31b-4b4e-a9e3-54f682e16707 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "c1", "ram": 256, "disk": 1}} {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:14.456949 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:36:14.456949 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: warnings.warn(msg) Nov 23 07:36:14.503157 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-548e34e5-a31b-4b4e-a9e3-54f682e16707 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.132638 Nov 23 07:36:14.509064 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 3/5] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Nov 23 07:36:14 2021] POST /compute/v2.1/flavors => generated 407 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:36:14.963398 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-1d14b767-c1de-4c2b-b5af-2dfc4d506ce3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:14.966512 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:36:14.966512 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: warnings.warn(msg) Nov 23 07:36:15.049163 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-1d14b767-c1de-4c2b-b5af-2dfc4d506ce3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.530492 Nov 23 07:36:15.061743 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 3/6] 10.222.0.48 () {64 vars in 1335 bytes} [Tue Nov 23 07:36:14 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:36:17.631342 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-548e34e5-a31b-4b4e-a9e3-54f682e16707 admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:36:17.632857 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-548e34e5-a31b-4b4e-a9e3-54f682e16707 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001883 Nov 23 07:36:17.633397 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 4/7] 10.222.0.48 () {54 vars in 930 bytes} [Tue Nov 23 07:36:17 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:36:17.816000 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-28a68f63-ebf3-4cdd-93cc-58f880fcfd3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d1", "vcpus": 1, "name": "ds512M", "ram": 512, "disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:17.834504 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:36:17.834504 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: warnings.warn(msg) Nov 23 07:36:17.857648 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-28a68f63-ebf3-4cdd-93cc-58f880fcfd3f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.212836 Nov 23 07:36:17.858266 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 4/8] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Nov 23 07:36:17 2021] POST /compute/v2.1/flavors => generated 404 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:36:17.871139 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-fa5652db-9673-4304-8d3c-f03b6796500b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:17.872998 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:36:17.872998 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: warnings.warn(msg) Nov 23 07:36:17.910654 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-fa5652db-9673-4304-8d3c-f03b6796500b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043007 Nov 23 07:36:17.911764 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 5/9] 10.222.0.48 () {64 vars in 1335 bytes} [Tue Nov 23 07:36:17 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:36:20.333498 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-28a68f63-ebf3-4cdd-93cc-58f880fcfd3f admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:36:20.334438 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-28a68f63-ebf3-4cdd-93cc-58f880fcfd3f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Nov 23 07:36:20.335384 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 930 bytes} [Tue Nov 23 07:36:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:36:20.442174 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-3563619e-8850-43de-947e-59b50a9ed8f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2", "disk": 10, "vcpus": 1, "ram": 1024}} {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:20.477878 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-3563619e-8850-43de-947e-59b50a9ed8f3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.131183 Nov 23 07:36:20.479015 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 6/11] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Nov 23 07:36:20 2021] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:36:20.501617 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-f11bcf91-5424-4698-8548-a451a1b59ea5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:20.540981 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-f11bcf91-5424-4698-8548-a451a1b59ea5 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046943 Nov 23 07:36:20.542751 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 6/12] 10.222.0.48 () {64 vars in 1335 bytes} [Tue Nov 23 07:36:20 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:36:23.683280 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-3563619e-8850-43de-947e-59b50a9ed8f3 admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:36:23.684898 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-3563619e-8850-43de-947e-59b50a9ed8f3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002502 Nov 23 07:36:23.685672 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 7/13] 10.222.0.48 () {54 vars in 930 bytes} [Tue Nov 23 07:36:23 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:36:23.760410 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-2d6a7580-44ef-43bd-9b06-475b492ff7c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:23.782941 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-2d6a7580-44ef-43bd-9b06-475b492ff7c6 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.089568 Nov 23 07:36:23.783772 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 7/14] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Nov 23 07:36:23 2021] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:36:23.803364 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-bf834fc4-c0c5-4032-a3c5-8ec0535fc247 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:23.837732 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-bf834fc4-c0c5-4032-a3c5-8ec0535fc247 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040561 Nov 23 07:36:23.838880 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 8/15] 10.222.0.48 () {64 vars in 1335 bytes} [Tue Nov 23 07:36:23 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:36:26.462526 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-2d6a7580-44ef-43bd-9b06-475b492ff7c6 admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:36:26.464810 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-2d6a7580-44ef-43bd-9b06-475b492ff7c6 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002759 Nov 23 07:36:26.467144 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 8/16] 10.222.0.48 () {54 vars in 930 bytes} [Tue Nov 23 07:36:26 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:36:26.531892 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-693d211a-016b-4309-8791-77947a283d8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4}} {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:26.553516 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-693d211a-016b-4309-8791-77947a283d8c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080781 Nov 23 07:36:26.554139 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 9/17] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Nov 23 07:36:26 2021] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:36:26.567293 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-3eb3ee37-6cc4-4649-aef2-c177dd5290c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:26.592791 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-3eb3ee37-6cc4-4649-aef2-c177dd5290c0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028871 Nov 23 07:36:26.593634 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 9/18] 10.222.0.48 () {64 vars in 1335 bytes} [Tue Nov 23 07:36:26 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:36:29.043188 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-693d211a-016b-4309-8791-77947a283d8c admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:36:29.044913 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-693d211a-016b-4309-8791-77947a283d8c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002117 Nov 23 07:36:29.050255 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 10/19] 10.222.0.48 () {54 vars in 930 bytes} [Tue Nov 23 07:36:29 2021] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:36:29.120729 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-27ce4df6-4753-4779-aa3a-6f502b3d8330 admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:36:29.149253 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-27ce4df6-4753-4779-aa3a-6f502b3d8330 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.096385 Nov 23 07:36:29.152256 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 10/20] 10.222.0.48 () {60 vars in 1291 bytes} [Tue Nov 23 07:36:29 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:36:31.740605 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-693d211a-016b-4309-8791-77947a283d8c admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:36:31.741633 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-693d211a-016b-4309-8791-77947a283d8c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Nov 23 07:36:31.742482 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 11/21] 10.222.0.48 () {54 vars in 930 bytes} [Tue Nov 23 07:36:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:36:31.839719 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-c5eaad03-adc3-43b8-aafe-630a4ac843ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 512}} {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:31.878174 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-c5eaad03-adc3-43b8-aafe-630a4ac843ee admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.121364 Nov 23 07:36:31.879627 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 11/22] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Nov 23 07:36:31 2021] POST /compute/v2.1/flavors => generated 402 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:36:31.892439 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-138c15a6-2f89-452a-8ee4-91b1747722e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:31.925370 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-138c15a6-2f89-452a-8ee4-91b1747722e8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036354 Nov 23 07:36:31.928451 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 12/23] 10.222.0.48 () {64 vars in 1332 bytes} [Tue Nov 23 07:36:31 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:36:34.390121 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-c5eaad03-adc3-43b8-aafe-630a4ac843ee admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:36:34.391174 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-c5eaad03-adc3-43b8-aafe-630a4ac843ee admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002100 Nov 23 07:36:34.391598 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 930 bytes} [Tue Nov 23 07:36:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:36:34.489006 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-ff4c030b-d3e9-4860-adfc-931f3fe5375c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1, "id": "2", "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:34.508696 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-ff4c030b-d3e9-4860-adfc-931f3fe5375c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.109629 Nov 23 07:36:34.509271 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 13/25] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Nov 23 07:36:34 2021] POST /compute/v2.1/flavors => generated 405 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:36:34.528126 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-7a4fd3e5-7631-4d9b-a304-ec5374f5fe85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:34.583007 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-7a4fd3e5-7631-4d9b-a304-ec5374f5fe85 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062901 Nov 23 07:36:34.584500 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 13/26] 10.222.0.48 () {64 vars in 1332 bytes} [Tue Nov 23 07:36:34 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:36:36.994057 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-ff4c030b-d3e9-4860-adfc-931f3fe5375c admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:36:36.995090 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-ff4c030b-d3e9-4860-adfc-931f3fe5375c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Nov 23 07:36:36.995495 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 14/27] 10.222.0.48 () {54 vars in 930 bytes} [Tue Nov 23 07:36:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:36:37.062196 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-5082950b-4313-405f-ae41-01685c256fc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40, "id": "3", "os-flavor-access:is_public": true, "ram": 4096, "swap": 0}} {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:37.089175 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-5082950b-4313-405f-ae41-01685c256fc4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.086988 Nov 23 07:36:37.089756 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 14/28] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Nov 23 07:36:37 2021] POST /compute/v2.1/flavors => generated 406 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:36:37.103004 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-b8a1b66f-374e-4c7f-82e8-aacfe414a30c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:37.128681 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-b8a1b66f-374e-4c7f-82e8-aacfe414a30c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029556 Nov 23 07:36:37.129274 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 15/29] 10.222.0.48 () {64 vars in 1332 bytes} [Tue Nov 23 07:36:37 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:36:39.483296 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-5082950b-4313-405f-ae41-01685c256fc4 admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:36:39.484772 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-5082950b-4313-405f-ae41-01685c256fc4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 Nov 23 07:36:39.485421 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 15/30] 10.222.0.48 () {54 vars in 930 bytes} [Tue Nov 23 07:36:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:36:39.557773 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-2e28c688-e9b8-4ec9-b154-dee6ea31057e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4"}} {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:39.580228 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-2e28c688-e9b8-4ec9-b154-dee6ea31057e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.087187 Nov 23 07:36:39.581476 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 16/31] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Nov 23 07:36:39 2021] POST /compute/v2.1/flavors => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:36:39.602247 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-cbb3e413-db75-4025-9411-429969a625c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:39.631662 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-cbb3e413-db75-4025-9411-429969a625c9 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033859 Nov 23 07:36:39.633194 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 16/32] 10.222.0.48 () {64 vars in 1332 bytes} [Tue Nov 23 07:36:39 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:36:42.012950 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-2e28c688-e9b8-4ec9-b154-dee6ea31057e admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:36:42.018371 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-2e28c688-e9b8-4ec9-b154-dee6ea31057e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002237 Nov 23 07:36:42.019021 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 17/33] 10.222.0.48 () {54 vars in 930 bytes} [Tue Nov 23 07:36:42 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:36:42.103389 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-d18e7f66-aeee-443a-8eac-6feb44d779bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "swap": 0, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true, "disk": 160}} {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:42.123104 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-d18e7f66-aeee-443a-8eac-6feb44d779bb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.097064 Nov 23 07:36:42.123666 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 17/34] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Nov 23 07:36:42 2021] POST /compute/v2.1/flavors => generated 408 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:36:42.135831 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-dbd2c838-a4a4-439b-9967-4daae516ae19 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:36:42.161746 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-dbd2c838-a4a4-439b-9967-4daae516ae19 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029372 Nov 23 07:36:42.174170 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 18/35] 10.222.0.48 () {64 vars in 1332 bytes} [Tue Nov 23 07:36:42 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:37:04.640424 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-d18e7f66-aeee-443a-8eac-6feb44d779bb admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:04.641500 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-d18e7f66-aeee-443a-8eac-6feb44d779bb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Nov 23 07:37:04.641917 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 18/36] 10.222.0.48 () {54 vars in 930 bytes} [Tue Nov 23 07:37:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:37:04.701148 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-3c1cb48e-dc1c-4c87-b8c9-aaed7c06b36a admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:04.718336 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-3c1cb48e-dc1c-4c87-b8c9-aaed7c06b36a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069596 Nov 23 07:37:04.718879 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 19/37] 10.222.0.48 () {60 vars in 1291 bytes} [Tue Nov 23 07:37:04 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:37:06.249485 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-d18e7f66-aeee-443a-8eac-6feb44d779bb admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:06.250521 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-d18e7f66-aeee-443a-8eac-6feb44d779bb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Nov 23 07:37:06.250925 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 19/38] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Nov 23 07:37:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:37:06.441605 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-02f645ea-e517-4896-9f72-545ca7a8d5c5 admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:06.447089 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.wsgi [None req-02f645ea-e517-4896-9f72-545ca7a8d5c5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 23 07:37:06.447653 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-02f645ea-e517-4896-9f72-545ca7a8d5c5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:37:06.448464 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-02f645ea-e517-4896-9f72-545ca7a8d5c5 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058308 Nov 23 07:37:06.448979 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 20/39] 10.222.0.48 () {60 vars in 1190 bytes} [Tue Nov 23 07:37:06 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 07:37:06.459927 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-a3a373b7-38ca-4870-a779-9e6719427ab3 admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:06.480650 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-a3a373b7-38ca-4870-a779-9e6719427ab3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024797 Nov 23 07:37:06.481227 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 20/40] 10.222.0.48 () {60 vars in 1210 bytes} [Tue Nov 23 07:37:06 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:37:06.492240 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-38faf073-f1ca-4fc7-ae62-a7e2a6f7388d admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:06.512789 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-38faf073-f1ca-4fc7-ae62-a7e2a6f7388d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024545 Nov 23 07:37:06.513885 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 21/41] 10.222.0.48 () {60 vars in 1210 bytes} [Tue Nov 23 07:37:06 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:37:06.523952 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-5a05f4a7-dc02-49e5-a1be-d69b60a617ff admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:06.529466 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.wsgi [None req-5a05f4a7-dc02-49e5-a1be-d69b60a617ff admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 23 07:37:06.530069 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-5a05f4a7-dc02-49e5-a1be-d69b60a617ff admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:37:06.530859 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-5a05f4a7-dc02-49e5-a1be-d69b60a617ff admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010462 Nov 23 07:37:06.531360 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 21/42] 10.222.0.48 () {60 vars in 1190 bytes} [Tue Nov 23 07:37:06 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 07:37:07.950268 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-38faf073-f1ca-4fc7-ae62-a7e2a6f7388d admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:07.951889 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-38faf073-f1ca-4fc7-ae62-a7e2a6f7388d admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Nov 23 07:37:07.952301 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 22/43] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Nov 23 07:37:07 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:37:08.153010 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-aec93205-85ee-4b9d-b440-21b8977c2710 admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:08.159218 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.wsgi [None req-aec93205-85ee-4b9d-b440-21b8977c2710 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 23 07:37:08.159779 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-aec93205-85ee-4b9d-b440-21b8977c2710 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:37:08.160565 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-aec93205-85ee-4b9d-b440-21b8977c2710 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062487 Nov 23 07:37:08.161083 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 22/44] 10.222.0.48 () {60 vars in 1190 bytes} [Tue Nov 23 07:37:08 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 07:37:08.171614 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-710530a7-ffb4-4f05-8199-f26a27394059 admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:08.185185 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-710530a7-ffb4-4f05-8199-f26a27394059 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017938 Nov 23 07:37:08.185765 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 23/45] 10.222.0.48 () {60 vars in 1210 bytes} [Tue Nov 23 07:37:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:37:08.195689 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-eb13f7ae-9820-4bf0-9f7b-a935cff5996f admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:08.208971 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-eb13f7ae-9820-4bf0-9f7b-a935cff5996f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016727 Nov 23 07:37:08.209501 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 23/46] 10.222.0.48 () {60 vars in 1210 bytes} [Tue Nov 23 07:37:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:37:08.219784 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-609f9507-7e4d-462e-8c31-17fa6d5eb903 admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:08.225214 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.wsgi [None req-609f9507-7e4d-462e-8c31-17fa6d5eb903 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 23 07:37:08.225815 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-609f9507-7e4d-462e-8c31-17fa6d5eb903 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:37:08.226604 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-609f9507-7e4d-462e-8c31-17fa6d5eb903 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010909 Nov 23 07:37:08.227111 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 24/47] 10.222.0.48 () {60 vars in 1190 bytes} [Tue Nov 23 07:37:08 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 23 07:37:09.602598 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-eb13f7ae-9820-4bf0-9f7b-a935cff5996f admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:09.603597 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-eb13f7ae-9820-4bf0-9f7b-a935cff5996f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Nov 23 07:37:09.603992 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 24/48] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Nov 23 07:37:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:37:09.796107 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-93697464-c62d-484d-b743-896f19a2c446 admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:09.801301 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.wsgi [None req-93697464-c62d-484d-b743-896f19a2c446 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 23 07:37:09.801894 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-93697464-c62d-484d-b743-896f19a2c446 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:37:09.802681 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-93697464-c62d-484d-b743-896f19a2c446 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059684 Nov 23 07:37:09.803200 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 25/49] 10.222.0.48 () {60 vars in 1193 bytes} [Tue Nov 23 07:37:09 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 07:37:09.813070 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-508cee30-b2bc-499b-b945-7a169f0a791d admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:09.826438 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-508cee30-b2bc-499b-b945-7a169f0a791d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016997 Nov 23 07:37:09.826990 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 25/50] 10.222.0.48 () {60 vars in 1210 bytes} [Tue Nov 23 07:37:09 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:37:09.837729 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-4da866b0-8772-4ec9-ae06-054ab40c43cc admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:09.851103 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-4da866b0-8772-4ec9-ae06-054ab40c43cc admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017305 Nov 23 07:37:09.851638 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 26/51] 10.222.0.48 () {60 vars in 1210 bytes} [Tue Nov 23 07:37:09 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:37:09.862239 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-8321d2be-1f07-4336-bc77-ee30a7b2f3fa admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:09.867857 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.wsgi [None req-8321d2be-1f07-4336-bc77-ee30a7b2f3fa admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 23 07:37:09.868405 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-8321d2be-1f07-4336-bc77-ee30a7b2f3fa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:37:09.869230 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-8321d2be-1f07-4336-bc77-ee30a7b2f3fa admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011155 Nov 23 07:37:09.869744 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 26/52] 10.222.0.48 () {60 vars in 1193 bytes} [Tue Nov 23 07:37:09 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 07:37:11.280328 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-4da866b0-8772-4ec9-ae06-054ab40c43cc admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:11.281405 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-4da866b0-8772-4ec9-ae06-054ab40c43cc admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Nov 23 07:37:11.281821 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 27/53] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Nov 23 07:37:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:37:11.472156 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-7d66dee4-f76d-4da6-b6c2-df6ddc1e5c74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:37:11.491321 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-7d66dee4-f76d-4da6-b6c2-df6ddc1e5c74 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071956 Nov 23 07:37:11.491860 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 27/54] 10.222.0.48 () {64 vars in 1235 bytes} [Tue Nov 23 07:37:11 2021] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:37:12.898638 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-4da866b0-8772-4ec9-ae06-054ab40c43cc admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:12.899645 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-4da866b0-8772-4ec9-ae06-054ab40c43cc admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Nov 23 07:37:12.900053 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 28/55] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Nov 23 07:37:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:37:13.092782 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-caa6b40b-b346-4ab7-ab39-e2d853461329 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:37:13.110683 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-caa6b40b-b346-4ab7-ab39-e2d853461329 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071802 Nov 23 07:37:13.111141 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 28/56] 10.222.0.48 () {64 vars in 1235 bytes} [Tue Nov 23 07:37:13 2021] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:37:14.496078 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-4da866b0-8772-4ec9-ae06-054ab40c43cc admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:14.497085 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-4da866b0-8772-4ec9-ae06-054ab40c43cc admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Nov 23 07:37:14.497489 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 29/57] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Nov 23 07:37:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:37:14.689770 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-99b17268-170c-46bb-b965-24a4c6a5fcf6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:37:14.707543 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-99b17268-170c-46bb-b965-24a4c6a5fcf6 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069523 Nov 23 07:37:14.708013 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 29/58] 10.222.0.48 () {64 vars in 1235 bytes} [Tue Nov 23 07:37:14 2021] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:37:16.120002 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-4da866b0-8772-4ec9-ae06-054ab40c43cc admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:16.121014 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-4da866b0-8772-4ec9-ae06-054ab40c43cc admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Nov 23 07:37:16.121408 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 30/59] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Nov 23 07:37:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:37:16.312309 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-8ee8e534-2cf2-4d10-84b8-47712c66db39 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:37:16.330077 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-8ee8e534-2cf2-4d10-84b8-47712c66db39 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069157 Nov 23 07:37:16.330550 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 30/60] 10.222.0.48 () {64 vars in 1235 bytes} [Tue Nov 23 07:37:16 2021] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:37:17.722099 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-4da866b0-8772-4ec9-ae06-054ab40c43cc admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:17.723110 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-4da866b0-8772-4ec9-ae06-054ab40c43cc admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Nov 23 07:37:17.723528 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 31/61] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Nov 23 07:37:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:37:17.920446 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-e879c45a-d1e9-48cf-ae8f-290776663269 admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:37:17.945205 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-e879c45a-d1e9-48cf-ae8f-290776663269 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.079579 Nov 23 07:37:17.945720 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 31/62] 10.222.0.48 () {60 vars in 1202 bytes} [Tue Nov 23 07:37:17 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:38:05.033418 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-4da866b0-8772-4ec9-ae06-054ab40c43cc admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:38:05.034457 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-4da866b0-8772-4ec9-ae06-054ab40c43cc admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Nov 23 07:38:05.034868 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 32/63] 10.222.0.48 () {54 vars in 930 bytes} [Tue Nov 23 07:38:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:38:05.097151 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-ec244534-a224-425a-910a-b68f5522d3d0 admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:38:05.115803 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-ec244534-a224-425a-910a-b68f5522d3d0 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073844 Nov 23 07:38:05.116345 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 32/64] 10.222.0.48 () {60 vars in 1291 bytes} [Tue Nov 23 07:38:05 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:38:05.138057 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-a78b16d2-bffa-49be-9e6f-8e4b88f7c388 admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:38:05.146088 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-a78b16d2-bffa-49be-9e6f-8e4b88f7c388 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011508 Nov 23 07:38:05.146607 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 33/65] 10.222.0.48 () {60 vars in 1282 bytes} [Tue Nov 23 07:38:05 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:38:05.158442 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-95464e8c-704c-4e65-88c8-bf4e6296e047 admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:38:05.165880 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-95464e8c-704c-4e65-88c8-bf4e6296e047 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011449 Nov 23 07:38:05.166398 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 33/66] 10.222.0.48 () {60 vars in 1285 bytes} [Tue Nov 23 07:38:05 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:38:05.177531 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-00c45c15-8072-4659-9846-77565e7f2c67 admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:38:05.184763 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-00c45c15-8072-4659-9846-77565e7f2c67 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010658 Nov 23 07:38:05.185274 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 34/67] 10.222.0.48 () {60 vars in 1285 bytes} [Tue Nov 23 07:38:05 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:38:05.196498 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-7b99723d-50fa-443c-8756-e7dbffb8d1b8 admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:38:05.204317 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-7b99723d-50fa-443c-8756-e7dbffb8d1b8 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010711 Nov 23 07:38:05.204830 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 34/68] 10.222.0.48 () {60 vars in 1282 bytes} [Tue Nov 23 07:38:05 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:39:31.212700 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-59950942-c913-49f3-8191-b28ab7047882 tempest-verify_tempest_config-1043586107 tempest-verify_tempest_config-1043586107-project] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:39:31.214734 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-59950942-c913-49f3-8191-b28ab7047882 tempest-verify_tempest_config-1043586107 tempest-verify_tempest_config-1043586107-project] 10.222.0.48 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.122311 Nov 23 07:39:31.215277 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 35/69] 10.222.0.48 () {58 vars in 1133 bytes} [Tue Nov 23 07:39:31 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:41:01.635990 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-7b99723d-50fa-443c-8756-e7dbffb8d1b8 admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:41:01.637008 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-7b99723d-50fa-443c-8756-e7dbffb8d1b8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Nov 23 07:41:01.637407 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 35/70] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Nov 23 07:41:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:41:01.920966 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-d9081670-c1f1-4a75-9464-58602d3b9f8f admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:41:01.922248 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:41:01.922248 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: warnings.warn(msg) Nov 23 07:41:01.923845 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-d9081670-c1f1-4a75-9464-58602d3b9f8f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:41:01.924293 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-d9081670-c1f1-4a75-9464-58602d3b9f8f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:41:01.925092 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-d9081670-c1f1-4a75-9464-58602d3b9f8f admin admin] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:41:01.925521 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-d9081670-c1f1-4a75-9464-58602d3b9f8f admin admin] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:41:01.960128 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-d9081670-c1f1-4a75-9464-58602d3b9f8f admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.174920 Nov 23 07:41:01.961201 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 36/71] 10.222.0.48 () {60 vars in 1193 bytes} [Tue Nov 23 07:41:01 2021] GET /compute/v2.1/os-services => generated 794 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:41:03.409474 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-7b99723d-50fa-443c-8756-e7dbffb8d1b8 admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:41:03.410500 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-7b99723d-50fa-443c-8756-e7dbffb8d1b8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Nov 23 07:41:03.410891 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 36/72] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Nov 23 07:41:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:41:03.607320 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-90ed968c-f97c-4bd8-8b59-7138500d4e7c admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:41:03.608664 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:41:03.608664 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: warnings.warn(msg) Nov 23 07:41:03.610303 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-90ed968c-f97c-4bd8-8b59-7138500d4e7c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:41:03.610753 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-90ed968c-f97c-4bd8-8b59-7138500d4e7c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:41:03.611555 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-90ed968c-f97c-4bd8-8b59-7138500d4e7c admin admin] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:41:03.612019 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-90ed968c-f97c-4bd8-8b59-7138500d4e7c admin admin] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:41:03.632336 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-90ed968c-f97c-4bd8-8b59-7138500d4e7c admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.079946 Nov 23 07:41:03.632844 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 37/73] 10.222.0.48 () {60 vars in 1193 bytes} [Tue Nov 23 07:41:03 2021] GET /compute/v2.1/os-services => generated 794 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:41:15.689315 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-7b99723d-50fa-443c-8756-e7dbffb8d1b8 admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:41:15.691210 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-7b99723d-50fa-443c-8756-e7dbffb8d1b8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002653 Nov 23 07:41:15.691961 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 37/74] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Nov 23 07:41:15 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:41:15.897758 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-a3755684-5989-440a-ada5-9de303e1d853 admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:41:15.899001 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:41:15.899001 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: warnings.warn(msg) Nov 23 07:41:15.900539 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-a3755684-5989-440a-ada5-9de303e1d853 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:41:15.900986 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-a3755684-5989-440a-ada5-9de303e1d853 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:41:15.901806 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-a3755684-5989-440a-ada5-9de303e1d853 admin admin] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:41:15.902237 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-a3755684-5989-440a-ada5-9de303e1d853 admin admin] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:41:15.928071 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-a3755684-5989-440a-ada5-9de303e1d853 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.086371 Nov 23 07:41:15.928892 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 38/75] 10.222.0.48 () {60 vars in 1193 bytes} [Tue Nov 23 07:41:15 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:41:17.365455 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: DEBUG nova.api.openstack.wsgi [None req-7b99723d-50fa-443c-8756-e7dbffb8d1b8 admin admin] Calling method '>' {{(pid=108592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:41:17.366518 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: INFO nova.api.openstack.requestlog [None req-7b99723d-50fa-443c-8756-e7dbffb8d1b8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Nov 23 07:41:17.366911 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: [pid: 108592|app: 0|req: 38/76] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Nov 23 07:41:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:41:17.566642 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG nova.api.openstack.wsgi [None req-946086e1-3d27-41d0-8cfe-308885180667 admin admin] Calling method '>' {{(pid=108591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:41:17.567836 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:41:17.567836 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: warnings.warn(msg) Nov 23 07:41:17.569385 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-946086e1-3d27-41d0-8cfe-308885180667 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:41:17.569870 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-946086e1-3d27-41d0-8cfe-308885180667 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:41:17.571349 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-946086e1-3d27-41d0-8cfe-308885180667 admin admin] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:41:17.571783 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: DEBUG oslo_concurrency.lockutils [None req-946086e1-3d27-41d0-8cfe-308885180667 admin admin] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:41:17.594291 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: INFO nova.api.openstack.requestlog [None req-946086e1-3d27-41d0-8cfe-308885180667 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.081099 Nov 23 07:41:17.594785 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: [pid: 108591|app: 0|req: 39/77] 10.222.0.48 () {60 vars in 1193 bytes} [Tue Nov 23 07:41:17 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:42:17.241562 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: Tue Nov 23 07:42:17 2021 - graceful shutdown triggered... Nov 23 07:42:17.241287 dv-cinder-804035-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 23 07:42:17.242538 dv-cinder-804035-14-iscsi devstack@n-api.service[108591]: Gracefully killing worker 1 (pid: 108591)... Nov 23 07:42:17.242897 dv-cinder-804035-14-iscsi devstack@n-api.service[108592]: Gracefully killing worker 2 (pid: 108592)... Nov 23 07:42:18.242316 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: worker 1 buried after 1 seconds Nov 23 07:42:18.242316 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: worker 2 buried after 1 seconds Nov 23 07:42:18.242316 dv-cinder-804035-14-iscsi devstack@n-api.service[108590]: goodbye to uWSGI. Nov 23 07:42:18.244481 dv-cinder-804035-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 23 07:42:18.245052 dv-cinder-804035-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 23 07:42:18.247883 dv-cinder-804035-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 23 07:42:18.257515 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 23 07:42:18.260676 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 23 07:42:18 2021] *** Nov 23 07:42:18.260834 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 23 07:42:18.260960 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 23 07:42:18.261074 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: nodename: dv-cinder-804035-14-iscsi Nov 23 07:42:18.261176 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: machine: x86_64 Nov 23 07:42:18.261307 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: clock source: unix Nov 23 07:42:18.261424 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: pcre jit disabled Nov 23 07:42:18.261535 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: detected number of CPU cores: 4 Nov 23 07:42:18.261659 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: current working directory: / Nov 23 07:42:18.261659 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: detected binary path: /usr/bin/uwsgi-core Nov 23 07:42:18.261659 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: your processes number limit is 47680 Nov 23 07:42:18.261659 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: your memory page size is 4096 bytes Nov 23 07:42:18.261659 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: detected max file descriptor number: 2048 Nov 23 07:42:18.261659 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: lock engine: pthread robust mutexes Nov 23 07:42:18.262146 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: thunder lock: enabled Nov 23 07:42:18.262146 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 23 07:42:18.262279 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 23 07:42:18.307631 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: Python main interpreter initialized at 0x5605bae599c0 Nov 23 07:42:18.307631 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: python threads support enabled Nov 23 07:42:18.307631 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: your server socket listen backlog is limited to 100 connections Nov 23 07:42:18.307631 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: your mercy for graceful operations on workers is 90 seconds Nov 23 07:42:18.308089 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: mapped 403077 bytes (393 KB) for 2 cores Nov 23 07:42:18.308089 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: *** Operational MODE: preforking *** Nov 23 07:42:18.308384 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: *** uWSGI is running in multiple interpreter mode *** Nov 23 07:42:18.308384 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: spawned uWSGI master process (pid: 122767) Nov 23 07:42:18.308596 dv-cinder-804035-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 23 07:42:18.309198 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: spawned uWSGI worker 1 (pid: 122785, cores: 1) Nov 23 07:42:18.309726 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: spawned uWSGI worker 2 (pid: 122786, cores: 1) Nov 23 07:42:18.310025 dv-cinder-804035-14-iscsi devstack@n-api.service[122767]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 23 07:42:20.098899 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 07:42:20.098899 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: from cryptography.utils import int_from_bytes Nov 23 07:42:20.099555 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 07:42:20.099555 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: from cryptography.utils import int_from_bytes Nov 23 07:42:20.145115 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 07:42:20.145115 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: from cryptography.utils import int_from_bytes Nov 23 07:42:20.145986 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 07:42:20.145986 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: from cryptography.utils import int_from_bytes Nov 23 07:42:22.459085 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 07:42:22.459668 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 07:42:22.459920 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 07:42:22.460215 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 07:42:22.460477 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 07:42:22.460868 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.461200 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.461528 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.461886 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.462224 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.462557 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.463422 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.463750 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.464083 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.464348 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.464667 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.464998 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-14-iscsi {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.465326 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.465682 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.465982 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.466305 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.466633 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.466945 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.467253 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.467756 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.469153 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.469153 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.469153 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.469153 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.469484 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.469803 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.470119 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.475071 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.475071 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.475071 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.475071 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-14-iscsi {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.475071 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.475071 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.475071 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.475071 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.475994 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.475994 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.475994 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.475994 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.475994 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.475994 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.475994 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.475994 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.476627 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.476627 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.476627 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.476627 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.476925 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.477110 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.477422 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.477680 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.479009 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.480267 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.480267 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.480267 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.480267 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.481889 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.481889 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.481889 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.481889 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.481889 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.482360 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.482360 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.482672 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.482988 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.483303 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.483615 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.483944 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.484267 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.484598 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.484912 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.485240 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.485653 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.485949 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.486266 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.486618 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.486946 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.487262 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.487593 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.487919 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.488275 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.488551 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.488865 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.489192 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.489540 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.489885 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.490143 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.490449 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.490761 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.491085 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.491399 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.491710 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.492023 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.492329 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.492641 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.492952 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.493264 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.493579 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.493928 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.494286 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.494628 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.494888 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.495198 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.495525 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.495856 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.496167 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.496478 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.496790 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.497100 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.497424 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.497767 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.498086 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.498437 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.498725 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.499032 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.499359 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.499669 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.499981 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.500308 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.500611 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.500922 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.501244 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.501555 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.501898 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.502208 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.502516 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.502824 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.503133 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.503439 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.503747 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.504049 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.504374 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.504699 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.505016 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.505327 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.505639 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.505990 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.506336 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.506677 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.507030 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.507353 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.507692 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.508031 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.508357 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.508679 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.509051 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.509330 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.510473 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.510657 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.510810 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.511130 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.511567 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.511797 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.512121 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.512444 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.512772 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.513088 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.513413 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.513771 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.514105 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.514425 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.514773 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.515121 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.515442 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.515774 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.516092 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.516465 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.516777 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.517059 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.517378 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.517746 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.518084 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.518396 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.518741 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.519076 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.519398 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.519712 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.520025 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.520364 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.520643 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.520957 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.521278 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.521609 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.521966 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.522293 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.522606 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.522918 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.523231 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.523544 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.523861 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.524173 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.524482 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.524807 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.525123 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.526197 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.526541 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.526854 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.527167 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.527491 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.527806 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.528128 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.528776 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.528776 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.529080 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.529402 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.529761 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.530100 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.530413 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.530745 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.531078 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.531404 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.531874 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.532089 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.532327 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.532635 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.532966 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.533261 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.533571 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.533952 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.534267 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.534580 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.534891 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.535219 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.535536 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.536387 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.536387 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.536978 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.537125 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.537969 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.537969 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.538264 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.538264 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.539431 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.539431 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.539431 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.540085 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.540085 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.540373 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.540524 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.540773 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.541119 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.541444 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.541790 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.542121 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.542441 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.542766 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.543082 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.543401 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.543745 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.544089 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.544406 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.544734 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.545050 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.545373 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.545685 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.546024 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.546339 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.546655 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.546979 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.547294 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.547618 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.547933 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.548258 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.548572 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.548896 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.549205 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.549552 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.549884 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.550223 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.550831 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.551064 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.551474 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.551714 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.552031 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.552351 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.552668 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.552974 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.553293 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.553614 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.553955 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.554480 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.554989 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.555510 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.555837 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.556152 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.556550 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.556887 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.557227 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.557550 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.557910 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.558246 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.558559 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.558947 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.559262 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.559584 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.559954 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.560269 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.560587 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.560945 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.561266 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.561584 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.561935 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.562264 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.562581 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.562908 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.563225 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.563543 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.564149 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.564248 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.564492 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.564933 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.565045 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 07:42:22.565451 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.565527 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 07:42:22.565609 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.565684 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 07:42:22.565885 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.566053 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 07:42:22.566138 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.566309 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 07:42:22.566412 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.566674 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.566775 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.566992 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.567075 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.567302 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.567401 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.567619 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.567725 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.567940 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.568043 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.568250 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.568534 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.568649 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.568872 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.568965 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.569196 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.569297 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.569459 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.569562 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.569801 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.569917 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.570128 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-14-iscsi {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.570233 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.570450 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.570553 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.570759 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.570862 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.571069 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.571172 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.571385 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.571487 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.571690 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.571787 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.572004 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.572095 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.572843 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.572975 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.573300 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.573401 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.573616 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.573724 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.573961 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.574063 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.574271 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.574363 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.574585 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.574686 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.574988 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.575096 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.575184 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.575309 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.575512 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.575614 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.575821 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.575927 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.576142 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.576283 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.576452 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.576552 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.576889 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.576996 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-14-iscsi {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.577100 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.577196 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.577395 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.577496 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.577720 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.577821 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.578043 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.578211 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.578354 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.578533 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.578665 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.579019 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.579329 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.579680 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.579786 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.580453 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.580560 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.580647 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.580722 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.580722 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.580858 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.580931 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.581008 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.581256 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.581340 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.581565 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.581647 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.581919 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.582027 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.582224 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.582308 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.589939 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.590080 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.590252 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.590344 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.590644 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.590723 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.590810 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.590953 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.591088 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.591218 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.591304 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.591377 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.591449 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.591519 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.591589 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.591668 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.591741 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.591819 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.591891 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.591963 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.592045 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.592125 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.592125 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.592265 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.592344 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.593712 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.593825 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.593910 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.593991 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.594065 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.594137 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.594221 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.594295 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.595225 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.595329 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.595413 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.595488 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.595574 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.595655 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.595752 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.595844 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.595918 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.595989 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.596070 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.596149 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.596222 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.596293 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.596371 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.596444 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.596544 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.596625 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.596698 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.596774 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.596847 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.596847 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.596991 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.596991 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.597133 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.597215 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.597293 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.597374 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.597448 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.597448 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.597574 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.597644 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.599256 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.599429 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.599585 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.599750 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.599921 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.600168 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.600326 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.600326 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.600632 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.600802 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.600960 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.600960 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.601256 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.601408 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.601567 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.601822 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.602008 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.602008 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.602324 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.602527 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.602689 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.602843 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.603005 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.603163 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.603325 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.603496 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.604014 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.604167 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.604326 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.604478 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.604638 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.604790 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.604949 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.605107 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.605266 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.605462 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.606224 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.606400 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.606590 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.606753 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.606914 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.607076 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.607228 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.607379 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.607539 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.607691 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.607858 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.608307 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.608469 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.608667 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.608827 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.608979 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.609139 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.609481 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.609648 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.609824 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.609977 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.610146 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.610410 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.610601 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.610768 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.610918 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.611077 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.611261 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.611831 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.612000 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.612154 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.612319 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.612480 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.612632 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.612790 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.612950 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.613102 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.613276 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.613429 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.613579 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.614158 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.614321 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.614473 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.614637 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.614798 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.614950 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.615102 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.615260 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.615412 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.615577 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.615742 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.615974 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.616140 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.616293 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.616459 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.616618 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.616770 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.616920 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.617078 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.617230 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.617393 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.617547 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.617715 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.617900 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.618053 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.618497 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.618659 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.618818 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.618970 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.619130 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.619282 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.619447 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.619609 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.619761 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.619912 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.620080 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.620232 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.620416 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.620661 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.620818 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.620969 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.621127 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 07:42:22.621289 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.621441 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.621601 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.621771 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.621929 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.622080 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.622259 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.622479 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.622669 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.622669 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.622970 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.623129 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.623299 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.623452 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.623603 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.623754 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.624079 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.624414 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.624627 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.624787 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.624946 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.625106 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.625265 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.625425 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.625585 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.625585 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.625920 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.626072 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.626229 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.626395 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.626553 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.626763 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.626918 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.627068 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.627218 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.627218 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.627515 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.627664 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.627822 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.627822 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.628108 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.628108 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.628691 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.628850 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.629021 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.629173 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.629332 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.629484 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.629634 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.629891 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.630055 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.630242 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.630406 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.630406 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.630802 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.630968 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.631131 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.631300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.631462 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.631614 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.631764 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.631915 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.632067 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.632218 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.632376 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.632535 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.632685 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.632843 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.632994 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.633165 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.633316 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.633467 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.633626 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.633813 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.633982 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.634478 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.635144 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.635300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.635458 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.635617 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.635769 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.635934 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.636105 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.636266 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.636425 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.636576 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.636734 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.636895 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.637056 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.637209 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.637361 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.637511 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.637674 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.637897 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.638051 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.638230 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.638230 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.638971 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.639156 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.639312 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.639504 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.639672 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.639833 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.639992 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.640157 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.640311 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.640471 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.640670 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.640670 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.641067 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.641240 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.641393 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.641552 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.641734 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.641903 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.642066 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.642217 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.642367 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.642525 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.642723 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.642890 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.643051 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.643210 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.643370 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.643521 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.643672 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.643963 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.644130 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.644474 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.644835 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.645568 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.645807 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.645970 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.646254 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.646425 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.646578 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.646736 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.646889 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.647048 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.647201 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.647359 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.647511 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.647662 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.647822 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.647987 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.648150 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.648318 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.648470 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.648628 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.648787 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.649298 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.649476 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.649636 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.649813 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.649979 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.650141 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.650345 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.651021 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.651299 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.651457 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.651457 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.651760 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.651920 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.652074 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.652226 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.652384 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.652617 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.652780 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.652940 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.653093 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.653257 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.653429 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.653588 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.653771 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.653948 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.654185 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.654349 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.654699 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.655085 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.655257 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.655411 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.655569 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.655720 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.655885 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.656062 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.656216 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.656366 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.656525 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.656676 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.656861 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.657031 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.657183 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.657342 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.657493 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.657643 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.657846 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.658011 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.658192 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.658347 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.658579 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.658777 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.658941 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.659221 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.659483 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.659640 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.659798 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.659997 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.660177 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.660331 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.660491 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.660665 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.660825 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.660978 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.661138 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.661315 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.661555 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.661991 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.662159 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.662349 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.662521 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.662673 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.662823 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.662988 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.663147 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.663306 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.663608 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.663769 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.663928 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.664087 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.664340 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.664507 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.664837 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.665181 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.665454 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.665612 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.665867 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.666038 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.666199 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.666358 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.666510 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.666660 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.666819 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.666984 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.667136 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.667294 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.667453 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.667604 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.667755 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.667925 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.667925 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.668241 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.668403 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.668562 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.668713 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.668874 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.669026 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.669194 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.669390 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.669673 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.669871 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.670025 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.670194 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.670346 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.670504 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.670664 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.670897 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.671053 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.671831 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.672004 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.672159 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.672310 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.672475 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.672628 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.672800 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.672953 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.673105 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.673269 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.673429 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.673606 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.673956 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.674132 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.674311 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.674566 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.674724 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.675111 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.675368 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.675655 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.675812 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.675975 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.676132 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.676283 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.676443 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.676603 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.676765 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.676924 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.677076 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.677236 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.677400 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.677631 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.677914 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.678084 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.678241 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.678400 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.678558 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.678710 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.678871 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.679022 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.679173 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.679334 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.679493 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.679690 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.679989 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.680147 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.680316 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.680476 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.680637 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.680637 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.680941 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.681101 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.681260 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.681260 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.681586 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.681777 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.682064 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.682222 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.682373 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.682533 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.682692 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.682692 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.682999 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.683151 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.683315 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.683475 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.683725 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.684117 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.684299 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.684453 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.684723 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.684931 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.685320 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.685598 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.685782 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.685940 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.686108 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.686372 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.686543 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.686705 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.686856 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.687018 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.687168 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.687317 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.687477 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.687637 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.687789 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.687947 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.688106 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.688269 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.688429 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.688589 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.688751 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.688944 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.689110 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.689270 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.689422 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.689580 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.689782 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.689969 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.690255 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.690421 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.690574 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.690725 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.690885 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.691046 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.691046 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.691360 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.691519 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.691672 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.691672 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.691957 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.692243 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.692407 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.692560 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.692718 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.692718 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.693013 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.693177 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.693341 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.693500 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.694434 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.694601 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.694861 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.695033 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.695214 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.695569 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.695830 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.695995 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.696225 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.696420 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.696708 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.696880 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.697032 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.697727 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.697901 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.698060 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.698226 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.698392 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.698552 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.698713 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.698877 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.699039 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.699201 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.699361 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.699538 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.699698 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.699850 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.700000 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.700169 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.700469 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.700629 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.700789 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.700941 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.701099 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.701260 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.701414 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.701565 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.701747 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.701918 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.702084 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.702362 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.702528 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.702682 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.702682 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.702969 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.703131 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.703327 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.703481 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.703641 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.703804 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.703956 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.704121 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.704274 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.704542 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.704701 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.704880 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.705123 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.705290 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.705462 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.705462 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.706090 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.706248 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.706429 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.706595 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.706889 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.707056 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.707253 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.707405 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.707573 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.707727 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.707727 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.708015 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.708178 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.708339 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.708571 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.708738 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.708917 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.709104 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.709259 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.709410 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.709574 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.709747 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.709905 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.710067 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.710227 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.710388 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.710690 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.710861 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.711023 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.711184 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.711342 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.711503 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.711658 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.711817 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.711978 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.712138 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.712298 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.712589 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.712787 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.713482 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.713673 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.713932 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.714088 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.714255 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.714415 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.714689 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.714848 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.715009 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.715286 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.715449 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.715601 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.715970 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.716241 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.716422 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.716590 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.716750 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.716926 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.717227 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.717385 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.717536 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.717732 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.717893 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.717893 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.718194 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.718345 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.718518 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.718684 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.718846 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.718997 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.719159 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.719312 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.719471 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.719623 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.719774 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.719774 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.720077 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.720239 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.720401 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.720569 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.720746 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.721065 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.721234 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.721386 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.721547 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.721771 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.721931 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.722082 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.722232 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.722401 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.722572 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.722839 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.722996 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.723156 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.723317 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.723478 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.723638 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.723798 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.723955 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.724107 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.724265 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.724432 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.724591 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.724841 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.725018 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.725179 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.725444 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.725602 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.725782 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.726115 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.726375 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.726578 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.726745 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.726899 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.727050 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.727228 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.727499 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.727671 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.727836 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.727990 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.728145 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.728307 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.728494 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.728649 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.728815 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.728976 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.729134 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.729294 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.729446 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.729622 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.729823 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.729977 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.730140 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.730300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.730452 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.730612 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.730765 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.730924 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.731092 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.731354 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.731513 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.731680 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.732822 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.733094 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.733264 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.733431 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.733584 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.733778 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.733948 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.734102 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.734254 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.734406 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.734565 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.734730 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.734998 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.735178 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.735374 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.735653 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.735653 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.735960 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.736356 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.736616 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.736774 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.736927 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.737094 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.737246 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.737404 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.737768 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.737941 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.738157 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.738316 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.738476 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.738629 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.738789 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.738950 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.739123 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.739323 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.739477 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.739629 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.739781 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.739947 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.740121 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.740276 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.741065 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.741229 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.741401 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.741693 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.741895 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.742052 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.742205 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.742357 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.742518 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.742518 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.742835 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.742835 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.743254 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.743414 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.743575 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.743747 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.743908 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.743908 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 07:42:22.744738 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.744738 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.744738 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.744738 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.744738 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.744738 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.744738 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.744738 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.746238 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.746238 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.746238 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.746238 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.746238 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.746238 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.746238 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.746238 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.747977 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.747977 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.747977 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.747977 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.747977 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.747977 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.747977 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.747977 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.749127 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.749127 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.749127 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.749127 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.749127 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.749127 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.749127 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.749127 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.750141 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.750141 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.750141 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.750141 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.750141 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.750141 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.750141 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.750141 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.751350 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.751350 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.751350 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.751350 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.751350 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.751350 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.751350 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.751350 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.752687 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.752687 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.752687 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.752687 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.752687 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.752687 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.752687 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.752687 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.754125 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.754125 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.754125 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.754125 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.754125 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.754125 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.754125 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.754125 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.755505 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.755505 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.755505 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.755505 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.755505 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.755505 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.755505 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.755505 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.757235 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.757402 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_db.sqlalchemy.engines [None req-13285b72-76c9-4c08-9f5f-c8c4699f7f90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122785) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 07:42:22.757609 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.757609 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.757609 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.757609 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.757609 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.757609 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.757609 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.757609 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.759168 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.759168 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.759168 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.759168 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.759168 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.759168 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.759168 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.759168 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.760901 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.760901 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.760901 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.760901 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.760901 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.760901 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.760901 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.760901 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.762300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.762300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.762300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.762300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.762300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.762300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.762300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.762300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.763495 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.763495 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.763495 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.763495 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.763495 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.763495 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.763495 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.763495 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.764779 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.764779 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.764779 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.764779 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.764779 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.764779 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.764779 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.764779 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.766319 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.766319 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.766319 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.766319 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.766319 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.766319 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.766319 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.766319 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.767943 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.767943 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.767943 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.767943 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.767943 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.767943 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.767943 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.769144 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.769144 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.769144 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.769144 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.769144 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.769144 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.769144 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.769144 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.770376 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.770376 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.770376 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.770376 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.770376 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.770376 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.770376 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.770376 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.771581 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.771581 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.771581 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.771581 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.771581 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.771581 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.771581 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.771581 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.772936 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.772936 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.772936 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.772936 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.772936 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.772936 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.772936 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.772936 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.774476 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.774476 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.774476 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.774476 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.774476 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.774476 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.774476 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.774476 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.775819 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.775819 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.775819 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.775819 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.775819 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.775819 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.775819 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.775819 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.777346 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.777346 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.777346 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.777346 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.777346 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.777346 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.777346 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.777346 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.778893 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.778893 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.778893 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.778893 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.778893 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.779628 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.779628 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.779628 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.780059 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.780217 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.780424 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.780729 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.781045 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.781351 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.781663 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.781995 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.782329 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.782674 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.782938 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.783264 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.783576 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.783900 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.784197 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.784512 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.785008 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.785246 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.785879 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.786189 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.786629 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.787119 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.787514 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.787811 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.788060 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.788368 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.788691 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.789001 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.789310 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.789614 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.790024 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.790337 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.790649 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.791003 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.791317 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.791630 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.791950 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.792303 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.792626 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.792947 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.793248 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.793565 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.793917 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.794337 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.794652 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.795000 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.795323 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.795663 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.796023 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.796284 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.796773 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.797045 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.797489 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.797811 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.798105 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.798328 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.798653 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.798969 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.799482 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.799665 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.799928 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.800274 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.800606 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.801382 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.801382 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.801693 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.801910 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.802143 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.802474 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.802808 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.803429 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.803598 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.803803 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.804130 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.804441 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.804764 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.805091 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.805415 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.805861 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.806065 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.806381 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.807412 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.808893 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.808893 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.809331 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.809493 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.809933 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.810277 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.810592 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.810930 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.811256 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.811601 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.811897 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.812216 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.812554 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.812871 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.813192 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.813522 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.813846 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.814168 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.814675 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.814891 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.815141 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.815470 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.818865 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.818865 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.818865 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.818865 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.818865 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.818865 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.818865 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.818865 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 07:42:22.822841 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 07:42:22.842609 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_db.sqlalchemy.engines [None req-b9fe7d5a-2549-4ec3-b5be-03447d848ba3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 07:42:22.897402 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.context [None req-13285b72-76c9-4c08-9f5f-c8c4699f7f90 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),00cd383d-2cfa-4558-9f64-d93e8a76ade1(cell1) {{(pid=122785) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 07:42:22.902777 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13285b72-76c9-4c08-9f5f-c8c4699f7f90 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:42:22.904368 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13285b72-76c9-4c08-9f5f-c8c4699f7f90 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:42:22.905244 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13285b72-76c9-4c08-9f5f-c8c4699f7f90 None None] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:42:22.907353 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13285b72-76c9-4c08-9f5f-c8c4699f7f90 None None] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:42:22.919536 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_db.sqlalchemy.engines [None req-13285b72-76c9-4c08-9f5f-c8c4699f7f90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122785) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 07:42:22.920431 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_db.sqlalchemy.engines [None req-13285b72-76c9-4c08-9f5f-c8c4699f7f90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122785) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 07:42:23.003595 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.context [None req-b9fe7d5a-2549-4ec3-b5be-03447d848ba3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),00cd383d-2cfa-4558-9f64-d93e8a76ade1(cell1) {{(pid=122786) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 07:42:23.008095 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b9fe7d5a-2549-4ec3-b5be-03447d848ba3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:42:23.009799 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b9fe7d5a-2549-4ec3-b5be-03447d848ba3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:42:23.010637 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b9fe7d5a-2549-4ec3-b5be-03447d848ba3 None None] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:42:23.012634 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b9fe7d5a-2549-4ec3-b5be-03447d848ba3 None None] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:42:23.024198 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_db.sqlalchemy.engines [None req-b9fe7d5a-2549-4ec3-b5be-03447d848ba3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 07:42:23.026318 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_db.sqlalchemy.engines [None req-b9fe7d5a-2549-4ec3-b5be-03447d848ba3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 07:42:23.084174 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_db.sqlalchemy.engines [None req-13285b72-76c9-4c08-9f5f-c8c4699f7f90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122785) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 07:42:23.188528 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_db.sqlalchemy.engines [None req-b9fe7d5a-2549-4ec3-b5be-03447d848ba3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 07:42:23.418036 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: WARNING keystonemiddleware.auth_token [None req-13285b72-76c9-4c08-9f5f-c8c4699f7f90 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 07:42:23.424695 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: WARNING keystonemiddleware.auth_token [None req-13285b72-76c9-4c08-9f5f-c8c4699f7f90 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 07:42:23.516130 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: WARNING keystonemiddleware.auth_token [None req-b9fe7d5a-2549-4ec3-b5be-03447d848ba3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 07:42:23.522831 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: WARNING keystonemiddleware.auth_token [None req-b9fe7d5a-2549-4ec3-b5be-03447d848ba3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 07:42:23.769561 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: WARNING keystonemiddleware.auth_token [None req-13285b72-76c9-4c08-9f5f-c8c4699f7f90 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 07:42:23.774824 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: WARNING keystonemiddleware.auth_token [None req-13285b72-76c9-4c08-9f5f-c8c4699f7f90 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 07:42:23.782076 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5605bae599c0 pid: 122785 (default app) Nov 23 07:42:23.878667 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: WARNING keystonemiddleware.auth_token [None req-b9fe7d5a-2549-4ec3-b5be-03447d848ba3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 07:42:23.883986 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: WARNING keystonemiddleware.auth_token [None req-b9fe7d5a-2549-4ec3-b5be-03447d848ba3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 07:42:23.889382 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5605bae599c0 pid: 122786 (default app) Nov 23 07:42:57.003635 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-9f1be6aa-7122-4adf-b75f-f83a2c85e307 tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] Action: 'create', calling method: .version_select at 0x7f051673a1f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-284759465", "metadata": {"Type": "work"}}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:42:57.005417 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-9f1be6aa-7122-4adf-b75f-f83a2c85e307 tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:42:57.006392 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-9f1be6aa-7122-4adf-b75f-f83a2c85e307 tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.053219 Nov 23 07:42:57.007386 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1155 bytes} [Tue Nov 23 07:42:55 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1055 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 07:42:57.234634 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-72f20730-5909-4037-9c63-544c06d8be5c tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] Action: 'create', calling method: .version_select at 0x7f0516775e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-39486782", "metadata": {"Type": "work"}}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:42:57.236366 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-72f20730-5909-4037-9c63-544c06d8be5c tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:42:57.237283 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-72f20730-5909-4037-9c63-544c06d8be5c tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.223333 Nov 23 07:42:57.238088 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 1/2] 10.222.0.48 () {60 vars in 1155 bytes} [Tue Nov 23 07:42:57 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 225 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 07:42:57.247400 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-9fbf24a9-9fc7-49e6-9315-d5ccca4b29d5 tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] Action: 'create', calling method: .version_select at 0x7f051673adc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-223096079", "metadata": {"Type": "work"}}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:42:57.248591 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-9fbf24a9-9fc7-49e6-9315-d5ccca4b29d5 tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:42:57.249728 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-9fbf24a9-9fc7-49e6-9315-d5ccca4b29d5 tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006531 Nov 23 07:42:57.250276 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 2/3] 10.222.0.48 () {60 vars in 1155 bytes} [Tue Nov 23 07:42:57 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 07:42:57.261115 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-628868f0-8156-484f-b30d-c6070988cc6d tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] Calling method '.version_select at 0x7f05166f99d0>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:42:59.054680 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-628868f0-8156-484f-b30d-c6070988cc6d tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] HTTP exception thrown: Volume tempest-invalid-807497029 could not be found. Nov 23 07:42:59.056391 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-628868f0-8156-484f-b30d-c6070988cc6d tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] Returning 404 to user: Volume tempest-invalid-807497029 could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:42:59.059324 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-628868f0-8156-484f-b30d-c6070988cc6d tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-807497029" status: 404 len: 98 microversion: 2.1 time: 1.802596 Nov 23 07:42:59.060502 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1214 bytes} [Tue Nov 23 07:42:57 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-807497029 => generated 98 bytes in 1806 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 23 07:42:59.070629 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-071ae86d-88f5-40d4-9beb-323178f96645 tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003769 Nov 23 07:42:59.075803 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 3/5] 10.222.0.48 () {58 vars in 1139 bytes} [Tue Nov 23 07:42:59 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 23 07:42:59.080975 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-3d467c3a-cb92-42c7-bc62-d186ce1cd8b8 tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004229 Nov 23 07:42:59.095586 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-18a1f0ec-a482-43ea-b28a-68850ea99d14 tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] Calling method '.version_select at 0x7f051673a9d0>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:42:59.101784 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 3/6] 10.222.0.48 () {58 vars in 1136 bytes} [Tue Nov 23 07:42:59 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 23 07:43:00.109751 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-18a1f0ec-a482-43ea-b28a-68850ea99d14 tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] HTTP exception thrown: Volume 5f9f550a-db28-46b7-bf11-feeb52d37ab2 could not be found. Nov 23 07:43:00.111197 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-18a1f0ec-a482-43ea-b28a-68850ea99d14 tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] Returning 404 to user: Volume 5f9f550a-db28-46b7-bf11-feeb52d37ab2 could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:43:00.112360 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-18a1f0ec-a482-43ea-b28a-68850ea99d14 tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/5f9f550a-db28-46b7-bf11-feeb52d37ab2" status: 404 len: 109 microversion: 2.1 time: 1.025505 Nov 23 07:43:00.113732 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1247 bytes} [Tue Nov 23 07:42:59 2021] DELETE /compute/v2.1/os-volumes/5f9f550a-db28-46b7-bf11-feeb52d37ab2 => generated 109 bytes in 1027 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:43:00.123764 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-47d1b04c-8921-40b4-8e6d-ff49e477b740 tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] Calling method '.version_select at 0x7f05165993a0>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:00.156990 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-605adbae-fbea-4f2c-b889-cea5a10c9096 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1687197886", "imageRef": "6895b3b6-16b9-4e43-bf1b-c19e73615ca8", "flavorRef": "452", "networks": [{"uuid": "9af761aa-3754-4538-98bd-443814fd3260"}]}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:43:00.180091 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-47d1b04c-8921-40b4-8e6d-ff49e477b740 tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] HTTP exception thrown: Volume 462fe9be-1244-4517-8761-154e2485b3a9 could not be found. Nov 23 07:43:00.180993 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-47d1b04c-8921-40b4-8e6d-ff49e477b740 tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] Returning 404 to user: Volume 462fe9be-1244-4517-8761-154e2485b3a9 could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:43:00.182614 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-47d1b04c-8921-40b4-8e6d-ff49e477b740 tempest-VolumesNegativeTest-511644078 tempest-VolumesNegativeTest-511644078-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/462fe9be-1244-4517-8761-154e2485b3a9" status: 404 len: 109 microversion: 2.1 time: 0.063236 Nov 23 07:43:00.184517 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1244 bytes} [Tue Nov 23 07:43:00 2021] GET /compute/v2.1/os-volumes/462fe9be-1244-4517-8761-154e2485b3a9 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:43:00.312826 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.network.neutron [None req-605adbae-fbea-4f2c-b889-cea5a10c9096 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] validate_networks() for [('9af761aa-3754-4538-98bd-443814fd3260', None, None, None, None, None)] {{(pid=122786) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:43:02.997309 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-605adbae-fbea-4f2c-b889-cea5a10c9096 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Flavor limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:43:02.998008 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-605adbae-fbea-4f2c-b889-cea5a10c9096 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Image limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:43:02.998573 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-605adbae-fbea-4f2c-b889-cea5a10c9096 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Flavor pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:43:02.998694 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-605adbae-fbea-4f2c-b889-cea5a10c9096 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Image pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:43:02.999084 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-605adbae-fbea-4f2c-b889-cea5a10c9096 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:43:03.034529 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-605adbae-fbea-4f2c-b889-cea5a10c9096 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:03.035282 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-605adbae-fbea-4f2c-b889-cea5a10c9096 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:03.036307 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-605adbae-fbea-4f2c-b889-cea5a10c9096 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:03.040499 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-605adbae-fbea-4f2c-b889-cea5a10c9096 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:03.118685 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-605adbae-fbea-4f2c-b889-cea5a10c9096 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Getting quotas for project 3d02de9f94b74169860663f89342f9d8. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:43:03.129315 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-605adbae-fbea-4f2c-b889-cea5a10c9096 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Getting quotas for user 6774f2e9c6be478184c03e319c96eaba and project 3d02de9f94b74169860663f89342f9d8. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:43:03.144639 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-605adbae-fbea-4f2c-b889-cea5a10c9096 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Going to run 1 instances... {{(pid=122786) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:43:03.148332 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-605adbae-fbea-4f2c-b889-cea5a10c9096 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6895b3b6-16b9-4e43-bf1b-c19e73615ca8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:43:03.338179 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-605adbae-fbea-4f2c-b889-cea5a10c9096 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.788603 Nov 23 07:43:03.345987 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 4/9] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Nov 23 07:42:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 3797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 07:43:03.351059 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-9895d757-7fa8-4826-8dab-673ea358174b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:03.352194 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-9895d757-7fa8-4826-8dab-673ea358174b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:03.535435 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-9895d757-7fa8-4826-8dab-673ea358174b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:03.561024 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-9895d757-7fa8-4826-8dab-673ea358174b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1215 microversion: 2.1 time: 0.211646 Nov 23 07:43:03.564700 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 6/10] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:03 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1215 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:43:04.585073 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e4475d22-b657-4ea7-9fa2-093e9a219641 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:04.588754 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e4475d22-b657-4ea7-9fa2-093e9a219641 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:04.814031 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-e4475d22-b657-4ea7-9fa2-093e9a219641 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:04.865683 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e4475d22-b657-4ea7-9fa2-093e9a219641 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1215 microversion: 2.1 time: 0.284755 Nov 23 07:43:04.869096 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 5/11] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:04 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1215 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:43:05.886528 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-b081fa2d-8fc4-4e34-8131-216d9b8f7b97 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:05.887831 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-b081fa2d-8fc4-4e34-8131-216d9b8f7b97 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:05.901154 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b081fa2d-8fc4-4e34-8131-216d9b8f7b97 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:05.903032 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b081fa2d-8fc4-4e34-8131-216d9b8f7b97 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:05.905841 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b081fa2d-8fc4-4e34-8131-216d9b8f7b97 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:05.908743 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b081fa2d-8fc4-4e34-8131-216d9b8f7b97 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:06.228275 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-b081fa2d-8fc4-4e34-8131-216d9b8f7b97 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:06.248332 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-b081fa2d-8fc4-4e34-8131-216d9b8f7b97 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1211 microversion: 2.1 time: 0.366177 Nov 23 07:43:06.249460 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 7/12] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:05 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1211 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:07.274554 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e3644a11-7d47-40d3-80d2-1e9ea932283f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:07.275221 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e3644a11-7d47-40d3-80d2-1e9ea932283f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:07.294912 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e3644a11-7d47-40d3-80d2-1e9ea932283f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:07.297160 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e3644a11-7d47-40d3-80d2-1e9ea932283f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:07.301070 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e3644a11-7d47-40d3-80d2-1e9ea932283f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:07.303145 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e3644a11-7d47-40d3-80d2-1e9ea932283f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:07.863479 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-e3644a11-7d47-40d3-80d2-1e9ea932283f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:07.880702 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e3644a11-7d47-40d3-80d2-1e9ea932283f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1273 microversion: 2.1 time: 0.618407 Nov 23 07:43:07.882039 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 6/13] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:07 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1273 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:08.901505 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ea6ac9e3-bcc8-4b38-9e35-376d3f964e13 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:08.904410 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ea6ac9e3-bcc8-4b38-9e35-376d3f964e13 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:08.919332 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ea6ac9e3-bcc8-4b38-9e35-376d3f964e13 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:08.920255 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ea6ac9e3-bcc8-4b38-9e35-376d3f964e13 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:08.931872 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ea6ac9e3-bcc8-4b38-9e35-376d3f964e13 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:08.934430 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ea6ac9e3-bcc8-4b38-9e35-376d3f964e13 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:09.392328 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ea6ac9e3-bcc8-4b38-9e35-376d3f964e13 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:09.409689 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ea6ac9e3-bcc8-4b38-9e35-376d3f964e13 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1273 microversion: 2.1 time: 0.512966 Nov 23 07:43:09.411576 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 8/14] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:08 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1273 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:09.618676 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-5f9ff703-14b9-4680-b471-cf7f6a920023 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'create', calling method: .version_select at 0x7f05153ef3a0>, body: {"keypair": {"name": "tempest-keypair-1190121129"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:43:09.677448 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-5f9ff703-14b9-4680-b471-cf7f6a920023 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Getting quotas for project bc7f91007a2a4b90b80701592589a131. Resources: {'key_pairs'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:43:09.683624 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-5f9ff703-14b9-4680-b471-cf7f6a920023 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Getting quotas for user 6a88554481924707acaf2afd81d18793 and project bc7f91007a2a4b90b80701592589a131. Resources: {'key_pairs'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:43:10.429991 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ed616cb1-91ff-41a7-86d1-353e1ef8f13c tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:10.430700 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ed616cb1-91ff-41a7-86d1-353e1ef8f13c tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:10.441062 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ed616cb1-91ff-41a7-86d1-353e1ef8f13c tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:10.444407 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ed616cb1-91ff-41a7-86d1-353e1ef8f13c tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:10.446690 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ed616cb1-91ff-41a7-86d1-353e1ef8f13c tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:10.449925 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ed616cb1-91ff-41a7-86d1-353e1ef8f13c tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:10.458804 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-5f9ff703-14b9-4680-b471-cf7f6a920023 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Getting quotas for project bc7f91007a2a4b90b80701592589a131. Resources: {'key_pairs'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:43:10.485112 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-5f9ff703-14b9-4680-b471-cf7f6a920023 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Getting quotas for user 6a88554481924707acaf2afd81d18793 and project bc7f91007a2a4b90b80701592589a131. Resources: {'key_pairs'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:43:10.557537 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-5f9ff703-14b9-4680-b471-cf7f6a920023 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.282323 Nov 23 07:43:10.574622 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 7/15] 10.222.0.48 () {60 vars in 1157 bytes} [Tue Nov 23 07:43:09 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:43:13.151414 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ed616cb1-91ff-41a7-86d1-353e1ef8f13c tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:13.167031 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ed616cb1-91ff-41a7-86d1-353e1ef8f13c tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1315 microversion: 2.1 time: 2.741945 Nov 23 07:43:13.169982 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 9/16] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:10 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1315 bytes in 2746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:43:14.190085 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a21faf2e-43e1-4e8a-82f7-c61ac4201aea tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:14.191180 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a21faf2e-43e1-4e8a-82f7-c61ac4201aea tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:14.219595 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a21faf2e-43e1-4e8a-82f7-c61ac4201aea tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:14.228434 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a21faf2e-43e1-4e8a-82f7-c61ac4201aea tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:14.232100 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a21faf2e-43e1-4e8a-82f7-c61ac4201aea tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:14.233027 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a21faf2e-43e1-4e8a-82f7-c61ac4201aea tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:15.063383 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a21faf2e-43e1-4e8a-82f7-c61ac4201aea tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:15.076152 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a21faf2e-43e1-4e8a-82f7-c61ac4201aea tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1315 microversion: 2.1 time: 0.892202 Nov 23 07:43:15.081198 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 8/17] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:14 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1315 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:15.913132 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-2a0938a2-9194-43cf-96fa-f2b1cdec6a13 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'create', calling method: .version_select at 0x7f0516559c10>, body: {"keypair": {"name": "tempest-keypair-109841872"}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:43:16.099270 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ea99ef69-5a86-47bf-8560-4f30656ce0d7 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:16.100044 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ea99ef69-5a86-47bf-8560-4f30656ce0d7 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:16.111460 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea99ef69-5a86-47bf-8560-4f30656ce0d7 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:16.112682 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea99ef69-5a86-47bf-8560-4f30656ce0d7 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:16.115502 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea99ef69-5a86-47bf-8560-4f30656ce0d7 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:16.118155 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea99ef69-5a86-47bf-8560-4f30656ce0d7 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:16.169830 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-2a0938a2-9194-43cf-96fa-f2b1cdec6a13 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Getting quotas for project edd4c40a2d5e481eadb2fc728cc0ca5a. Resources: {'key_pairs'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:43:16.210395 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-2a0938a2-9194-43cf-96fa-f2b1cdec6a13 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Getting quotas for user 204926c3a4fe4664bc1cd685b57fe015 and project edd4c40a2d5e481eadb2fc728cc0ca5a. Resources: {'key_pairs'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:43:17.105422 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ea99ef69-5a86-47bf-8560-4f30656ce0d7 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:17.153604 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ea99ef69-5a86-47bf-8560-4f30656ce0d7 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1315 microversion: 2.1 time: 1.056082 Nov 23 07:43:17.169618 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 9/18] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:16 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1315 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:17.897358 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-2a0938a2-9194-43cf-96fa-f2b1cdec6a13 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Getting quotas for project edd4c40a2d5e481eadb2fc728cc0ca5a. Resources: {'key_pairs'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:43:17.918444 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-2a0938a2-9194-43cf-96fa-f2b1cdec6a13 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Getting quotas for user 204926c3a4fe4664bc1cd685b57fe015 and project edd4c40a2d5e481eadb2fc728cc0ca5a. Resources: {'key_pairs'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:43:17.963812 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-2a0938a2-9194-43cf-96fa-f2b1cdec6a13 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 3.028348 Nov 23 07:43:17.972193 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 10/19] 10.222.0.48 () {62 vars in 1198 bytes} [Tue Nov 23 07:43:14 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 3038 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Nov 23 07:43:18.179439 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8528135a-4465-43e7-9fb3-b28c6f61723e tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:18.180227 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8528135a-4465-43e7-9fb3-b28c6f61723e tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:18.193056 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8528135a-4465-43e7-9fb3-b28c6f61723e tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:18.198980 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8528135a-4465-43e7-9fb3-b28c6f61723e tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:18.203371 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8528135a-4465-43e7-9fb3-b28c6f61723e tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:18.205883 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8528135a-4465-43e7-9fb3-b28c6f61723e tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:19.197319 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-8528135a-4465-43e7-9fb3-b28c6f61723e tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:19.239060 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-8528135a-4465-43e7-9fb3-b28c6f61723e tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1315 microversion: 2.1 time: 1.054164 Nov 23 07:43:19.252791 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 10/20] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:18 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1315 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:19.894526 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-d60ebbbe-1ef9-46b4-a911-ab081fc1e345 req-e2b73b8b-400d-47fb-8046-b25534b42d21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be4189be-d8dd-4c98-8200-662d44bcb4a4", "tag": "54bccf3f-426b-4efd-8ab3-2d36cb64b211"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:43:19.896989 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:43:19.896989 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:43:19.952789 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-d60ebbbe-1ef9-46b4-a911-ab081fc1e345 req-e2b73b8b-400d-47fb-8046-b25534b42d21 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:19.962998 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-d60ebbbe-1ef9-46b4-a911-ab081fc1e345 req-e2b73b8b-400d-47fb-8046-b25534b42d21 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:20.041543 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-d60ebbbe-1ef9-46b4-a911-ab081fc1e345 req-e2b73b8b-400d-47fb-8046-b25534b42d21 service nova] Creating event network-changed:54bccf3f-426b-4efd-8ab3-2d36cb64b211 for instance be4189be-d8dd-4c98-8200-662d44bcb4a4 on hv-cinder-80403 Nov 23 07:43:20.042440 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-d60ebbbe-1ef9-46b4-a911-ab081fc1e345 req-e2b73b8b-400d-47fb-8046-b25534b42d21 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122785) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 23 07:43:20.049549 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a3ab4f0d-da9c-4a2f-a85d-bbcf0ad2e404 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:20.050145 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a3ab4f0d-da9c-4a2f-a85d-bbcf0ad2e404 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:20.051406 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a3ab4f0d-da9c-4a2f-a85d-bbcf0ad2e404 None None] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:20.052152 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a3ab4f0d-da9c-4a2f-a85d-bbcf0ad2e404 None None] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:20.088233 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.compute.rpcapi [None req-a3ab4f0d-da9c-4a2f-a85d-bbcf0ad2e404 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 23 07:43:20.094563 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a3ab4f0d-da9c-4a2f-a85d-bbcf0ad2e404 None None] Releasing lock "compute-rpcapi-router" {{(pid=122785) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 23 07:43:20.225196 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-a3ab4f0d-da9c-4a2f-a85d-bbcf0ad2e404 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.883931 Nov 23 07:43:20.230326 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 11/21] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:43:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:43:20.261662 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-21b2df27-9a7a-442c-a710-6ae0910f8b48 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:20.265841 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-21b2df27-9a7a-442c-a710-6ae0910f8b48 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:20.271328 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-793478a4-7914-40d3-b02d-87b944c08ee1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-630030497", "imageRef": "6895b3b6-16b9-4e43-bf1b-c19e73615ca8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41a8f465-c4c3-4408-a9dd-14556e78b966"}], "security_groups": [{"name": "tempest-securitygroup--1964586030"}], "key_name": "tempest-keypair-1190121129", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:43:20.280342 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-21b2df27-9a7a-442c-a710-6ae0910f8b48 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:20.281098 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-21b2df27-9a7a-442c-a710-6ae0910f8b48 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:20.283679 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-21b2df27-9a7a-442c-a710-6ae0910f8b48 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:20.285906 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-21b2df27-9a7a-442c-a710-6ae0910f8b48 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:21.441798 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.network.neutron [None req-793478a4-7914-40d3-b02d-87b944c08ee1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] validate_networks() for [('41a8f465-c4c3-4408-a9dd-14556e78b966', None, None, None, None, None)] {{(pid=122785) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:43:21.512254 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-21b2df27-9a7a-442c-a710-6ae0910f8b48 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:21.523123 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-21b2df27-9a7a-442c-a710-6ae0910f8b48 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1315 microversion: 2.1 time: 1.267072 Nov 23 07:43:21.534659 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 11/22] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:20 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1315 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:22.549601 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1978e4ae-f1df-491c-a8b6-1854159d83cd tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:22.553201 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1978e4ae-f1df-491c-a8b6-1854159d83cd tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:22.571224 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1978e4ae-f1df-491c-a8b6-1854159d83cd tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:22.574003 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1978e4ae-f1df-491c-a8b6-1854159d83cd tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:22.575192 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1978e4ae-f1df-491c-a8b6-1854159d83cd tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:22.579230 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1978e4ae-f1df-491c-a8b6-1854159d83cd tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:23.550443 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1978e4ae-f1df-491c-a8b6-1854159d83cd tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:23.576891 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1978e4ae-f1df-491c-a8b6-1854159d83cd tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1315 microversion: 2.1 time: 1.036858 Nov 23 07:43:23.578814 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 12/23] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:22 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1315 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:24.648824 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c93dc518-29a4-4a57-8125-99bb9d510ad2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1042899329", "imageRef": "6895b3b6-16b9-4e43-bf1b-c19e73615ca8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b78d8c29-35aa-4c8a-8439-dc361a48243a"}]}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:43:24.801730 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.network.neutron [None req-c93dc518-29a4-4a57-8125-99bb9d510ad2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] validate_networks() for [('b78d8c29-35aa-4c8a-8439-dc361a48243a', None, None, None, None, None)] {{(pid=122786) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:43:26.188091 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-793478a4-7914-40d3-b02d-87b944c08ee1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Flavor limits 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:43:26.194337 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-793478a4-7914-40d3-b02d-87b944c08ee1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Image limits 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:43:26.194577 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-793478a4-7914-40d3-b02d-87b944c08ee1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Flavor pref 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:43:26.195000 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-793478a4-7914-40d3-b02d-87b944c08ee1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Image pref 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:43:26.195421 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-793478a4-7914-40d3-b02d-87b944c08ee1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:43:26.214159 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-793478a4-7914-40d3-b02d-87b944c08ee1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:26.214906 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-793478a4-7914-40d3-b02d-87b944c08ee1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:26.220281 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-793478a4-7914-40d3-b02d-87b944c08ee1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:26.220826 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-793478a4-7914-40d3-b02d-87b944c08ee1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:26.298085 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-793478a4-7914-40d3-b02d-87b944c08ee1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Getting quotas for project bc7f91007a2a4b90b80701592589a131. Resources: {'instances', 'cores', 'ram'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:43:26.305138 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-793478a4-7914-40d3-b02d-87b944c08ee1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Getting quotas for user 6a88554481924707acaf2afd81d18793 and project bc7f91007a2a4b90b80701592589a131. Resources: {'instances', 'cores', 'ram'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:43:26.324654 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-793478a4-7914-40d3-b02d-87b944c08ee1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Going to run 1 instances... {{(pid=122785) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:43:26.328174 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-793478a4-7914-40d3-b02d-87b944c08ee1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6895b3b6-16b9-4e43-bf1b-c19e73615ca8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:43:26.420834 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-793478a4-7914-40d3-b02d-87b944c08ee1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.154882 Nov 23 07:43:26.422309 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 12/24] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Nov 23 07:43:20 2021] POST /compute/v2.1/servers => generated 402 bytes in 6157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 07:43:26.429400 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-fcc6d09e-3b00-438a-8619-61b1b1d441b4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:26.430700 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-fcc6d09e-3b00-438a-8619-61b1b1d441b4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:26.438479 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-c93dc518-29a4-4a57-8125-99bb9d510ad2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Flavor limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:43:26.439523 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-c93dc518-29a4-4a57-8125-99bb9d510ad2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Image limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:43:26.441001 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-c93dc518-29a4-4a57-8125-99bb9d510ad2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Flavor pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:43:26.442078 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-c93dc518-29a4-4a57-8125-99bb9d510ad2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Image pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:43:26.442990 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-c93dc518-29a4-4a57-8125-99bb9d510ad2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:43:26.455944 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c93dc518-29a4-4a57-8125-99bb9d510ad2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:26.456580 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c93dc518-29a4-4a57-8125-99bb9d510ad2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:26.458075 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c93dc518-29a4-4a57-8125-99bb9d510ad2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:26.458709 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c93dc518-29a4-4a57-8125-99bb9d510ad2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:26.461613 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fcc6d09e-3b00-438a-8619-61b1b1d441b4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:26.463952 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fcc6d09e-3b00-438a-8619-61b1b1d441b4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:26.466677 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fcc6d09e-3b00-438a-8619-61b1b1d441b4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:26.467154 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fcc6d09e-3b00-438a-8619-61b1b1d441b4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:26.480643 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-c93dc518-29a4-4a57-8125-99bb9d510ad2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Getting quotas for project ed47c8e5e9704a0abf5643f488f1b2be. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:43:26.486480 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-c93dc518-29a4-4a57-8125-99bb9d510ad2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Getting quotas for user 1f9ebd9d66ea4c5caba89d7620d28611 and project ed47c8e5e9704a0abf5643f488f1b2be. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:43:26.503204 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c93dc518-29a4-4a57-8125-99bb9d510ad2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Going to run 1 instances... {{(pid=122786) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:43:26.506844 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c93dc518-29a4-4a57-8125-99bb9d510ad2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6895b3b6-16b9-4e43-bf1b-c19e73615ca8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:43:26.597173 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c93dc518-29a4-4a57-8125-99bb9d510ad2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.910919 Nov 23 07:43:26.598455 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 13/25] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Nov 23 07:43:23 2021] POST /compute/v2.1/servers => generated 383 bytes in 2913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 07:43:26.607116 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-49ee6b3b-e55d-4b53-8c82-eef9e6e035cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-526401679", "imageRef": "6895b3b6-16b9-4e43-bf1b-c19e73615ca8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d9cb767d-e579-4bd6-9168-0f1ea7c41329"}], "security_groups": [{"name": "tempest-securitygroup--1702814656"}], "key_name": "tempest-keypair-109841872", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:43:26.880213 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.network.neutron [None req-49ee6b3b-e55d-4b53-8c82-eef9e6e035cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] validate_networks() for [('d9cb767d-e579-4bd6-9168-0f1ea7c41329', None, None, None, None, None)] {{(pid=122786) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:43:27.940417 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-fcc6d09e-3b00-438a-8619-61b1b1d441b4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:27.951906 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-fcc6d09e-3b00-438a-8619-61b1b1d441b4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1315 microversion: 2.1 time: 1.527973 Nov 23 07:43:27.952841 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 13/26] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:26 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1315 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:27.997888 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-cee7f750-3a81-48a6-a942-d36410585b76 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:27.998587 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-cee7f750-3a81-48a6-a942-d36410585b76 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:28.114867 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-49ee6b3b-e55d-4b53-8c82-eef9e6e035cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Flavor limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:43:28.115371 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-49ee6b3b-e55d-4b53-8c82-eef9e6e035cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Image limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:43:28.120860 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-49ee6b3b-e55d-4b53-8c82-eef9e6e035cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Flavor pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:43:28.121589 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-49ee6b3b-e55d-4b53-8c82-eef9e6e035cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Image pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:43:28.122555 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-49ee6b3b-e55d-4b53-8c82-eef9e6e035cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:43:28.141177 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-cee7f750-3a81-48a6-a942-d36410585b76 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:28.153207 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-cee7f750-3a81-48a6-a942-d36410585b76 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1237 microversion: 2.1 time: 0.171679 Nov 23 07:43:28.154236 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 14/27] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:27 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1237 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:28.167031 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-49ee6b3b-e55d-4b53-8c82-eef9e6e035cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:28.167491 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-49ee6b3b-e55d-4b53-8c82-eef9e6e035cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:28.168590 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-49ee6b3b-e55d-4b53-8c82-eef9e6e035cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:28.169618 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-49ee6b3b-e55d-4b53-8c82-eef9e6e035cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:28.171299 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-252bbb8d-fbff-4c96-be89-38cf8cb58cc1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:28.172206 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-252bbb8d-fbff-4c96-be89-38cf8cb58cc1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:28.189022 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-252bbb8d-fbff-4c96-be89-38cf8cb58cc1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:28.192650 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-252bbb8d-fbff-4c96-be89-38cf8cb58cc1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:28.193625 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-252bbb8d-fbff-4c96-be89-38cf8cb58cc1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:28.195853 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-252bbb8d-fbff-4c96-be89-38cf8cb58cc1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:28.225310 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-49ee6b3b-e55d-4b53-8c82-eef9e6e035cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Getting quotas for project edd4c40a2d5e481eadb2fc728cc0ca5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:43:28.235824 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-49ee6b3b-e55d-4b53-8c82-eef9e6e035cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Getting quotas for user 204926c3a4fe4664bc1cd685b57fe015 and project edd4c40a2d5e481eadb2fc728cc0ca5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:43:28.266639 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-49ee6b3b-e55d-4b53-8c82-eef9e6e035cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Going to run 1 instances... {{(pid=122786) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:43:28.274675 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-49ee6b3b-e55d-4b53-8c82-eef9e6e035cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6895b3b6-16b9-4e43-bf1b-c19e73615ca8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:43:28.332054 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-252bbb8d-fbff-4c96-be89-38cf8cb58cc1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:28.340511 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-252bbb8d-fbff-4c96-be89-38cf8cb58cc1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1218 microversion: 2.1 time: 0.181834 Nov 23 07:43:28.353740 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 15/28] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:28 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:28.386946 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-49ee6b3b-e55d-4b53-8c82-eef9e6e035cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.783893 Nov 23 07:43:28.393757 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 14/29] 10.222.0.48 () {62 vars in 1187 bytes} [Tue Nov 23 07:43:26 2021] POST /compute/v2.1/servers => generated 402 bytes in 1790 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 23 07:43:28.399418 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-4fc04204-503c-41a9-907b-5f6991df2cde tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:28.400120 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-4fc04204-503c-41a9-907b-5f6991df2cde tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:28.525927 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-4fc04204-503c-41a9-907b-5f6991df2cde tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:28.540403 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-4fc04204-503c-41a9-907b-5f6991df2cde tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:28.560773 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-4fc04204-503c-41a9-907b-5f6991df2cde tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:28.563689 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-4fc04204-503c-41a9-907b-5f6991df2cde tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1280 microversion: 2.20 time: 0.167273 Nov 23 07:43:28.567667 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 16/30] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:28 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1280 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:28.647305 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-f6fae2a9-5fd9-44b8-b61e-2a01ddcc42eb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-156284247", "imageRef": "6895b3b6-16b9-4e43-bf1b-c19e73615ca8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b78d8c29-35aa-4c8a-8439-dc361a48243a"}]}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:43:28.872050 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.network.neutron [None req-f6fae2a9-5fd9-44b8-b61e-2a01ddcc42eb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] validate_networks() for [('b78d8c29-35aa-4c8a-8439-dc361a48243a', None, None, None, None, None)] {{(pid=122786) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:43:28.972591 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5ee459b8-5736-4a46-9d59-94d7150b3d77 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:28.973221 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5ee459b8-5736-4a46-9d59-94d7150b3d77 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:28.984560 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5ee459b8-5736-4a46-9d59-94d7150b3d77 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:28.985937 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5ee459b8-5736-4a46-9d59-94d7150b3d77 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:28.990408 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5ee459b8-5736-4a46-9d59-94d7150b3d77 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:28.992366 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5ee459b8-5736-4a46-9d59-94d7150b3d77 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:29.847055 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5ee459b8-5736-4a46-9d59-94d7150b3d77 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:29.859006 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5ee459b8-5736-4a46-9d59-94d7150b3d77 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1315 microversion: 2.1 time: 0.893210 Nov 23 07:43:29.871312 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 17/31] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:28 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:29.888503 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-a9081a23-a828-43fa-b7ab-e03afbd52c79 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:29.889521 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-a9081a23-a828-43fa-b7ab-e03afbd52c79 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:29.923617 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a9081a23-a828-43fa-b7ab-e03afbd52c79 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:29.925227 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a9081a23-a828-43fa-b7ab-e03afbd52c79 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:29.947868 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a9081a23-a828-43fa-b7ab-e03afbd52c79 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:29.950467 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a9081a23-a828-43fa-b7ab-e03afbd52c79 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:30.000212 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-f6fae2a9-5fd9-44b8-b61e-2a01ddcc42eb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Flavor limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:43:30.001401 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-f6fae2a9-5fd9-44b8-b61e-2a01ddcc42eb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Image limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:43:30.001933 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-f6fae2a9-5fd9-44b8-b61e-2a01ddcc42eb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Flavor pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:43:30.002347 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-f6fae2a9-5fd9-44b8-b61e-2a01ddcc42eb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Image pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:43:30.003060 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-f6fae2a9-5fd9-44b8-b61e-2a01ddcc42eb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:43:30.024737 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f6fae2a9-5fd9-44b8-b61e-2a01ddcc42eb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:30.025406 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f6fae2a9-5fd9-44b8-b61e-2a01ddcc42eb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:30.029680 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f6fae2a9-5fd9-44b8-b61e-2a01ddcc42eb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:30.030378 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f6fae2a9-5fd9-44b8-b61e-2a01ddcc42eb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:30.118634 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-f6fae2a9-5fd9-44b8-b61e-2a01ddcc42eb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Getting quotas for project ed47c8e5e9704a0abf5643f488f1b2be. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:43:30.134790 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-f6fae2a9-5fd9-44b8-b61e-2a01ddcc42eb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Getting quotas for user 1f9ebd9d66ea4c5caba89d7620d28611 and project ed47c8e5e9704a0abf5643f488f1b2be. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:43:30.176164 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a9081a23-a828-43fa-b7ab-e03afbd52c79 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:30.186474 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f6fae2a9-5fd9-44b8-b61e-2a01ddcc42eb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Going to run 1 instances... {{(pid=122786) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:43:30.189140 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f6fae2a9-5fd9-44b8-b61e-2a01ddcc42eb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6895b3b6-16b9-4e43-bf1b-c19e73615ca8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:43:30.196784 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-a9081a23-a828-43fa-b7ab-e03afbd52c79 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1295 microversion: 2.1 time: 0.319344 Nov 23 07:43:30.200600 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 18/32] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:29 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1295 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:30.214371 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-aa553f94-c978-4b66-8fd1-3ebaf4b4b592 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:30.216068 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-aa553f94-c978-4b66-8fd1-3ebaf4b4b592 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:30.231021 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aa553f94-c978-4b66-8fd1-3ebaf4b4b592 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:30.232750 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aa553f94-c978-4b66-8fd1-3ebaf4b4b592 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:30.235007 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aa553f94-c978-4b66-8fd1-3ebaf4b4b592 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:30.237078 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aa553f94-c978-4b66-8fd1-3ebaf4b4b592 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:30.356908 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-f6fae2a9-5fd9-44b8-b61e-2a01ddcc42eb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.715698 Nov 23 07:43:30.363110 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 15/33] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Nov 23 07:43:28 2021] POST /compute/v2.1/servers => generated 383 bytes in 1723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 07:43:30.369400 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c2c49a2b-e7a6-4a95-b998-525ca8dc1738 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:30.370562 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c2c49a2b-e7a6-4a95-b998-525ca8dc1738 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:30.443714 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-aa553f94-c978-4b66-8fd1-3ebaf4b4b592 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:30.465354 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-aa553f94-c978-4b66-8fd1-3ebaf4b4b592 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:30.476911 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-aa553f94-c978-4b66-8fd1-3ebaf4b4b592 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:30.479502 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-aa553f94-c978-4b66-8fd1-3ebaf4b4b592 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1332 microversion: 2.20 time: 0.277214 Nov 23 07:43:30.479729 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-c2c49a2b-e7a6-4a95-b998-525ca8dc1738 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:30.490760 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 19/34] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:30 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1332 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:30.510144 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c2c49a2b-e7a6-4a95-b998-525ca8dc1738 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1221 microversion: 2.1 time: 0.145724 Nov 23 07:43:30.512260 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 16/35] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:30 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1221 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:30.882082 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-6de33f82-8a71-44d0-9cca-46923e148c28 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:30.883135 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-6de33f82-8a71-44d0-9cca-46923e148c28 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:30.894895 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6de33f82-8a71-44d0-9cca-46923e148c28 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:30.895641 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6de33f82-8a71-44d0-9cca-46923e148c28 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:30.900526 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6de33f82-8a71-44d0-9cca-46923e148c28 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:30.902109 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6de33f82-8a71-44d0-9cca-46923e148c28 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:31.226645 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ba767983-1e7b-4af8-b587-d0724f9741c3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:31.228361 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ba767983-1e7b-4af8-b587-d0724f9741c3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:31.251864 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ba767983-1e7b-4af8-b587-d0724f9741c3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:31.252429 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ba767983-1e7b-4af8-b587-d0724f9741c3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:31.256217 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ba767983-1e7b-4af8-b587-d0724f9741c3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:31.268684 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ba767983-1e7b-4af8-b587-d0724f9741c3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:31.579541 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-6de33f82-8a71-44d0-9cca-46923e148c28 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:31.590439 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-6de33f82-8a71-44d0-9cca-46923e148c28 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1315 microversion: 2.1 time: 0.713346 Nov 23 07:43:31.602417 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 20/36] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:30 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:31.611893 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-bb3e00e4-cc65-4c34-96d6-38504f020718 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:31.613172 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-bb3e00e4-cc65-4c34-96d6-38504f020718 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:31.620747 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bb3e00e4-cc65-4c34-96d6-38504f020718 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:31.621307 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bb3e00e4-cc65-4c34-96d6-38504f020718 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:31.622268 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bb3e00e4-cc65-4c34-96d6-38504f020718 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:31.623133 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bb3e00e4-cc65-4c34-96d6-38504f020718 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:31.733152 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ba767983-1e7b-4af8-b587-d0724f9741c3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:31.749266 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ba767983-1e7b-4af8-b587-d0724f9741c3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1295 microversion: 2.1 time: 0.528892 Nov 23 07:43:31.750812 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 17/37] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:31 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1295 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:31.766361 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-cf17f034-9f26-4e7e-947c-b73d66bb57b5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:31.767140 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-cf17f034-9f26-4e7e-947c-b73d66bb57b5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:31.773623 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-bb3e00e4-cc65-4c34-96d6-38504f020718 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:31.774385 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cf17f034-9f26-4e7e-947c-b73d66bb57b5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:31.775462 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cf17f034-9f26-4e7e-947c-b73d66bb57b5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:31.776328 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cf17f034-9f26-4e7e-947c-b73d66bb57b5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:31.776894 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cf17f034-9f26-4e7e-947c-b73d66bb57b5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:31.795109 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-bb3e00e4-cc65-4c34-96d6-38504f020718 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:31.796919 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-bb3e00e4-cc65-4c34-96d6-38504f020718 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:31.803558 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-bb3e00e4-cc65-4c34-96d6-38504f020718 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1338 microversion: 2.20 time: 0.198365 Nov 23 07:43:31.806700 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 21/38] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:31 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1338 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:31.939469 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-cf17f034-9f26-4e7e-947c-b73d66bb57b5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:31.959465 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-cf17f034-9f26-4e7e-947c-b73d66bb57b5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1273 microversion: 2.1 time: 0.199734 Nov 23 07:43:31.960336 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 18/39] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:31 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:32.611927 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ce1b6c7e-0522-4064-b0cf-f338bf473882 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:32.615630 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ce1b6c7e-0522-4064-b0cf-f338bf473882 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:32.629231 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ce1b6c7e-0522-4064-b0cf-f338bf473882 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:32.630076 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ce1b6c7e-0522-4064-b0cf-f338bf473882 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:32.631186 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ce1b6c7e-0522-4064-b0cf-f338bf473882 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:32.631968 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ce1b6c7e-0522-4064-b0cf-f338bf473882 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:32.767964 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-afc04946-27d8-45ce-8b61-0717d0ab236a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:32.768654 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-afc04946-27d8-45ce-8b61-0717d0ab236a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:32.775378 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-afc04946-27d8-45ce-8b61-0717d0ab236a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:32.775964 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-afc04946-27d8-45ce-8b61-0717d0ab236a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:32.776788 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-afc04946-27d8-45ce-8b61-0717d0ab236a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:32.777235 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-afc04946-27d8-45ce-8b61-0717d0ab236a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:32.969450 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-afc04946-27d8-45ce-8b61-0717d0ab236a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:32.982647 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-afc04946-27d8-45ce-8b61-0717d0ab236a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1295 microversion: 2.1 time: 0.218135 Nov 23 07:43:32.989518 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 19/40] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:32 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1295 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:43:33.000567 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-95e9ce89-464f-487f-a8b8-62df80811911 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:33.001555 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-95e9ce89-464f-487f-a8b8-62df80811911 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:33.021228 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-95e9ce89-464f-487f-a8b8-62df80811911 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:33.028113 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-95e9ce89-464f-487f-a8b8-62df80811911 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:33.029990 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-95e9ce89-464f-487f-a8b8-62df80811911 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:33.032060 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-95e9ce89-464f-487f-a8b8-62df80811911 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:33.154074 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-95e9ce89-464f-487f-a8b8-62df80811911 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:33.174557 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-95e9ce89-464f-487f-a8b8-62df80811911 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:33.176527 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-95e9ce89-464f-487f-a8b8-62df80811911 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:33.178453 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-95e9ce89-464f-487f-a8b8-62df80811911 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1338 microversion: 2.20 time: 0.186992 Nov 23 07:43:33.180564 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:32 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1338 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:33.193777 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-74c22c7f-b832-43b7-b223-dcbd44d5b237 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:33.194737 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-74c22c7f-b832-43b7-b223-dcbd44d5b237 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:33.202078 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-74c22c7f-b832-43b7-b223-dcbd44d5b237 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:33.203210 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-74c22c7f-b832-43b7-b223-dcbd44d5b237 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:33.204380 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-74c22c7f-b832-43b7-b223-dcbd44d5b237 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:33.205217 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-74c22c7f-b832-43b7-b223-dcbd44d5b237 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:33.331652 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-74c22c7f-b832-43b7-b223-dcbd44d5b237 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:33.344800 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-74c22c7f-b832-43b7-b223-dcbd44d5b237 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1279 microversion: 2.1 time: 0.162397 Nov 23 07:43:33.346370 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 21/42] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:33 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1279 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:33.420740 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ce1b6c7e-0522-4064-b0cf-f338bf473882 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:33.429537 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ce1b6c7e-0522-4064-b0cf-f338bf473882 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1315 microversion: 2.1 time: 0.824785 Nov 23 07:43:33.434481 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 22/43] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:32 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1315 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:33.903389 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-0b68ae9c-61d7-4daf-bc2c-138de63aad64 req-8476dbcb-2bc0-435c-b7ab-a4db2648c879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be4189be-d8dd-4c98-8200-662d44bcb4a4", "name": "network-vif-plugged", "status": "completed", "tag": "54bccf3f-426b-4efd-8ab3-2d36cb64b211"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:43:33.905933 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:43:33.905933 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:43:33.919845 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-0b68ae9c-61d7-4daf-bc2c-138de63aad64 req-8476dbcb-2bc0-435c-b7ab-a4db2648c879 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:33.920648 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-0b68ae9c-61d7-4daf-bc2c-138de63aad64 req-8476dbcb-2bc0-435c-b7ab-a4db2648c879 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:33.950787 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-0b68ae9c-61d7-4daf-bc2c-138de63aad64 req-8476dbcb-2bc0-435c-b7ab-a4db2648c879 service nova] Creating event network-vif-plugged:54bccf3f-426b-4efd-8ab3-2d36cb64b211 for instance be4189be-d8dd-4c98-8200-662d44bcb4a4 on hv-cinder-80403 Nov 23 07:43:33.951454 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-0b68ae9c-61d7-4daf-bc2c-138de63aad64 req-8476dbcb-2bc0-435c-b7ab-a4db2648c879 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122786) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 23 07:43:33.952727 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7d6dabeb-9ce0-47cf-9e5f-998f1ac0b749 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:33.953418 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7d6dabeb-9ce0-47cf-9e5f-998f1ac0b749 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:33.954496 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7d6dabeb-9ce0-47cf-9e5f-998f1ac0b749 None None] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:33.955174 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7d6dabeb-9ce0-47cf-9e5f-998f1ac0b749 None None] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:33.969180 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.compute.rpcapi [None req-7d6dabeb-9ce0-47cf-9e5f-998f1ac0b749 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 23 07:43:33.970357 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7d6dabeb-9ce0-47cf-9e5f-998f1ac0b749 None None] Releasing lock "compute-rpcapi-router" {{(pid=122786) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 23 07:43:33.998407 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-7d6dabeb-9ce0-47cf-9e5f-998f1ac0b749 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.260894 Nov 23 07:43:33.999134 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 22/44] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:43:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:43:34.006326 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-718ae9e5-97b5-47d4-b544-504e97e80782 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:34.007057 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-718ae9e5-97b5-47d4-b544-504e97e80782 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:34.014183 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-718ae9e5-97b5-47d4-b544-504e97e80782 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:34.014910 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-718ae9e5-97b5-47d4-b544-504e97e80782 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:34.015876 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-718ae9e5-97b5-47d4-b544-504e97e80782 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:34.016475 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-718ae9e5-97b5-47d4-b544-504e97e80782 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:34.197280 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-5fe70008-c11c-4f4e-ad9c-bf63118669dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:34.198643 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-5fe70008-c11c-4f4e-ad9c-bf63118669dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:34.206400 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5fe70008-c11c-4f4e-ad9c-bf63118669dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:34.207229 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5fe70008-c11c-4f4e-ad9c-bf63118669dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:34.208578 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5fe70008-c11c-4f4e-ad9c-bf63118669dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:34.209624 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5fe70008-c11c-4f4e-ad9c-bf63118669dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:34.492213 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-718ae9e5-97b5-47d4-b544-504e97e80782 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:34.511288 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-718ae9e5-97b5-47d4-b544-504e97e80782 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.508031 Nov 23 07:43:34.516992 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 23/45] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:34 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:34.530463 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-05da559c-84a8-47bc-a5a5-1bafd24a1554 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:34.531355 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-05da559c-84a8-47bc-a5a5-1bafd24a1554 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:34.538061 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-05da559c-84a8-47bc-a5a5-1bafd24a1554 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:34.539043 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-05da559c-84a8-47bc-a5a5-1bafd24a1554 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:34.540037 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-05da559c-84a8-47bc-a5a5-1bafd24a1554 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:34.540619 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-05da559c-84a8-47bc-a5a5-1bafd24a1554 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:34.622345 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5fe70008-c11c-4f4e-ad9c-bf63118669dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:34.633381 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5fe70008-c11c-4f4e-ad9c-bf63118669dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:34.638008 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5fe70008-c11c-4f4e-ad9c-bf63118669dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:34.640320 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-5fe70008-c11c-4f4e-ad9c-bf63118669dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1406 microversion: 2.20 time: 0.446772 Nov 23 07:43:34.641588 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 23/46] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:34 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1406 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:43:34.660699 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-272cf5b2-8b75-4253-a471-01778d95b3c4 req-8da1dc8d-aeee-4123-b23b-0945800cb714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5cba5f7-c9fd-4708-923c-deec6ab27cdd", "tag": "98e7ca52-3570-4eee-8b5d-7db714fe981a"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:43:34.660699 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:43:34.660699 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:43:34.681870 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-272cf5b2-8b75-4253-a471-01778d95b3c4 req-8da1dc8d-aeee-4123-b23b-0945800cb714 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:34.689008 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-272cf5b2-8b75-4253-a471-01778d95b3c4 req-8da1dc8d-aeee-4123-b23b-0945800cb714 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:34.706005 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-272cf5b2-8b75-4253-a471-01778d95b3c4 req-8da1dc8d-aeee-4123-b23b-0945800cb714 service nova] Creating event network-changed:98e7ca52-3570-4eee-8b5d-7db714fe981a for instance c5cba5f7-c9fd-4708-923c-deec6ab27cdd on hv-cinder-80403 Nov 23 07:43:34.713184 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-272cf5b2-8b75-4253-a471-01778d95b3c4 req-8da1dc8d-aeee-4123-b23b-0945800cb714 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069920 Nov 23 07:43:34.715978 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 24/47] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:43:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:43:34.722883 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-9ba567cc-c7ef-44b7-a6a2-c38cb8ecc141 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:34.724708 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-9ba567cc-c7ef-44b7-a6a2-c38cb8ecc141 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:34.740674 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9ba567cc-c7ef-44b7-a6a2-c38cb8ecc141 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:34.741468 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9ba567cc-c7ef-44b7-a6a2-c38cb8ecc141 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:34.743617 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9ba567cc-c7ef-44b7-a6a2-c38cb8ecc141 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:34.746452 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9ba567cc-c7ef-44b7-a6a2-c38cb8ecc141 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:34.861058 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-05da559c-84a8-47bc-a5a5-1bafd24a1554 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:34.871511 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-05da559c-84a8-47bc-a5a5-1bafd24a1554 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1321 microversion: 2.1 time: 0.352512 Nov 23 07:43:34.872935 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 24/48] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:34 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:34.997290 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-9ba567cc-c7ef-44b7-a6a2-c38cb8ecc141 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:35.006314 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-9ba567cc-c7ef-44b7-a6a2-c38cb8ecc141 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1315 microversion: 2.1 time: 0.288457 Nov 23 07:43:35.007450 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 25/49] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:34 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:35.533478 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-37f53379-3e6a-421c-a928-cde9a78f7dc2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:35.534270 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-37f53379-3e6a-421c-a928-cde9a78f7dc2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:35.545463 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-37f53379-3e6a-421c-a928-cde9a78f7dc2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:35.547266 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-37f53379-3e6a-421c-a928-cde9a78f7dc2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:35.550877 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-37f53379-3e6a-421c-a928-cde9a78f7dc2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:35.551595 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-37f53379-3e6a-421c-a928-cde9a78f7dc2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:35.658452 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-05aac01b-7a27-4597-b6f8-fd231a5d1474 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:35.659186 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-05aac01b-7a27-4597-b6f8-fd231a5d1474 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:35.667400 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-05aac01b-7a27-4597-b6f8-fd231a5d1474 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:35.668252 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-05aac01b-7a27-4597-b6f8-fd231a5d1474 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:35.669387 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-05aac01b-7a27-4597-b6f8-fd231a5d1474 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:35.669923 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-05aac01b-7a27-4597-b6f8-fd231a5d1474 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:35.724600 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-37f53379-3e6a-421c-a928-cde9a78f7dc2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:35.748905 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-37f53379-3e6a-421c-a928-cde9a78f7dc2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.218595 Nov 23 07:43:35.752007 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 25/50] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:35 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:35.863397 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-05aac01b-7a27-4597-b6f8-fd231a5d1474 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:35.872271 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-05aac01b-7a27-4597-b6f8-fd231a5d1474 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:35.875721 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-05aac01b-7a27-4597-b6f8-fd231a5d1474 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:35.876848 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-05aac01b-7a27-4597-b6f8-fd231a5d1474 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1406 microversion: 2.20 time: 0.222334 Nov 23 07:43:35.877584 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 26/51] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:35 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:35.888752 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-0ce0c3c1-e899-45e9-8adf-0cfeabd850e7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:35.889361 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-0ce0c3c1-e899-45e9-8adf-0cfeabd850e7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:35.895456 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0ce0c3c1-e899-45e9-8adf-0cfeabd850e7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:35.895908 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0ce0c3c1-e899-45e9-8adf-0cfeabd850e7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:35.896699 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0ce0c3c1-e899-45e9-8adf-0cfeabd850e7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:35.897132 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0ce0c3c1-e899-45e9-8adf-0cfeabd850e7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:36.023284 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-03b3ac98-bfa8-4659-8cb6-4daf5d595f50 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:36.024715 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-03b3ac98-bfa8-4659-8cb6-4daf5d595f50 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:36.039292 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-03b3ac98-bfa8-4659-8cb6-4daf5d595f50 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:36.041200 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-03b3ac98-bfa8-4659-8cb6-4daf5d595f50 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:36.043099 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-03b3ac98-bfa8-4659-8cb6-4daf5d595f50 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:36.043740 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-03b3ac98-bfa8-4659-8cb6-4daf5d595f50 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:36.103385 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0ce0c3c1-e899-45e9-8adf-0cfeabd850e7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:36.118526 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-0ce0c3c1-e899-45e9-8adf-0cfeabd850e7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1321 microversion: 2.1 time: 0.233767 Nov 23 07:43:36.120882 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 26/52] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:35 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:36.209630 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-03b3ac98-bfa8-4659-8cb6-4daf5d595f50 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:36.217911 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-03b3ac98-bfa8-4659-8cb6-4daf5d595f50 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1315 microversion: 2.1 time: 0.198286 Nov 23 07:43:36.218855 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 27/53] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:36 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:36.736453 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-a5a2a894-093b-4d0d-9340-52bb1e964f20 req-72b5eb06-e297-41a7-bca5-45127220750e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c2d383-cc82-4479-b0fe-d92e63ef538d", "tag": "12786728-e083-4cb6-b178-3facabd226a9"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:43:36.738796 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:43:36.738796 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:43:36.749226 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-a5a2a894-093b-4d0d-9340-52bb1e964f20 req-72b5eb06-e297-41a7-bca5-45127220750e service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:36.750246 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-a5a2a894-093b-4d0d-9340-52bb1e964f20 req-72b5eb06-e297-41a7-bca5-45127220750e service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:36.769888 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-a5a2a894-093b-4d0d-9340-52bb1e964f20 req-72b5eb06-e297-41a7-bca5-45127220750e service nova] Creating event network-changed:12786728-e083-4cb6-b178-3facabd226a9 for instance 28c2d383-cc82-4479-b0fe-d92e63ef538d on hv-cinder-80403 Nov 23 07:43:36.770032 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6860b9de-76bc-4e7e-b293-1a0c944be343 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:36.770621 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6860b9de-76bc-4e7e-b293-1a0c944be343 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:36.778739 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-a5a2a894-093b-4d0d-9340-52bb1e964f20 req-72b5eb06-e297-41a7-bca5-45127220750e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045682 Nov 23 07:43:36.779432 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 27/54] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:43:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:43:36.785553 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6860b9de-76bc-4e7e-b293-1a0c944be343 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:36.786797 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6860b9de-76bc-4e7e-b293-1a0c944be343 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:36.816619 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6860b9de-76bc-4e7e-b293-1a0c944be343 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:36.816619 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6860b9de-76bc-4e7e-b293-1a0c944be343 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:36.900649 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-8a2dbc57-30df-4474-b6b0-2d142b533dbd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:36.903627 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-8a2dbc57-30df-4474-b6b0-2d142b533dbd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:36.915369 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8a2dbc57-30df-4474-b6b0-2d142b533dbd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:36.916408 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8a2dbc57-30df-4474-b6b0-2d142b533dbd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:36.918478 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8a2dbc57-30df-4474-b6b0-2d142b533dbd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:36.919700 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8a2dbc57-30df-4474-b6b0-2d142b533dbd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:37.266669 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6860b9de-76bc-4e7e-b293-1a0c944be343 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:37.274072 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6860b9de-76bc-4e7e-b293-1a0c944be343 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.508557 Nov 23 07:43:37.274657 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 28/55] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:36 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:37.279028 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-038f0672-cd6c-4179-97e0-6dee74224efe tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:37.279632 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-038f0672-cd6c-4179-97e0-6dee74224efe tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:37.289511 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-038f0672-cd6c-4179-97e0-6dee74224efe tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:37.290246 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-038f0672-cd6c-4179-97e0-6dee74224efe tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:37.291305 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-038f0672-cd6c-4179-97e0-6dee74224efe tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:37.291921 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-038f0672-cd6c-4179-97e0-6dee74224efe tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:37.433328 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-8a2dbc57-30df-4474-b6b0-2d142b533dbd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:37.444973 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-8a2dbc57-30df-4474-b6b0-2d142b533dbd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:37.448803 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-8a2dbc57-30df-4474-b6b0-2d142b533dbd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:37.455176 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-8a2dbc57-30df-4474-b6b0-2d142b533dbd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1406 microversion: 2.20 time: 0.557946 Nov 23 07:43:37.456479 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 28/56] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:36 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1406 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:37.461510 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-4b73002a-dea9-45c2-abc3-0b9099d22752 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:37.462218 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-4b73002a-dea9-45c2-abc3-0b9099d22752 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:37.468440 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4b73002a-dea9-45c2-abc3-0b9099d22752 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:37.469233 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4b73002a-dea9-45c2-abc3-0b9099d22752 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:37.470401 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4b73002a-dea9-45c2-abc3-0b9099d22752 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:37.471290 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4b73002a-dea9-45c2-abc3-0b9099d22752 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:37.606296 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-038f0672-cd6c-4179-97e0-6dee74224efe tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:37.614315 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-038f0672-cd6c-4179-97e0-6dee74224efe tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1321 microversion: 2.1 time: 0.338532 Nov 23 07:43:37.627792 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 29/57] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:37 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:37.936956 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-4b73002a-dea9-45c2-abc3-0b9099d22752 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:37.949465 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-4b73002a-dea9-45c2-abc3-0b9099d22752 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1315 microversion: 2.1 time: 0.491347 Nov 23 07:43:37.950477 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 29/58] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:37 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:38.292955 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f4a3d0d0-bf35-4c8b-964f-0ce083f5a197 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:38.295341 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f4a3d0d0-bf35-4c8b-964f-0ce083f5a197 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:38.309285 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f4a3d0d0-bf35-4c8b-964f-0ce083f5a197 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:38.310138 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f4a3d0d0-bf35-4c8b-964f-0ce083f5a197 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:38.311197 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f4a3d0d0-bf35-4c8b-964f-0ce083f5a197 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:38.311867 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f4a3d0d0-bf35-4c8b-964f-0ce083f5a197 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:38.390161 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-c13fca5d-b43e-47b3-8648-59580f275899 req-d2f496da-ed83-4f26-a06e-2caad46df01c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b9df126-b886-4cb5-88f0-20dc6e22dbe1", "tag": "e60ee95d-4ae8-48a9-b92b-e6e28e265d71"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:43:38.391989 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:43:38.391989 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:43:38.399701 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-c13fca5d-b43e-47b3-8648-59580f275899 req-d2f496da-ed83-4f26-a06e-2caad46df01c service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:38.400591 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-c13fca5d-b43e-47b3-8648-59580f275899 req-d2f496da-ed83-4f26-a06e-2caad46df01c service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:38.423127 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-c13fca5d-b43e-47b3-8648-59580f275899 req-d2f496da-ed83-4f26-a06e-2caad46df01c service nova] Creating event network-changed:e60ee95d-4ae8-48a9-b92b-e6e28e265d71 for instance 6b9df126-b886-4cb5-88f0-20dc6e22dbe1 on hv-cinder-80403 Nov 23 07:43:38.437767 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-c13fca5d-b43e-47b3-8648-59580f275899 req-d2f496da-ed83-4f26-a06e-2caad46df01c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171690 Nov 23 07:43:38.438498 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 30/59] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:43:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:43:38.475170 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ea62e71c-aaef-4d34-8ad5-4342ef163e3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:38.475870 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ea62e71c-aaef-4d34-8ad5-4342ef163e3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:38.483473 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea62e71c-aaef-4d34-8ad5-4342ef163e3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:38.483917 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea62e71c-aaef-4d34-8ad5-4342ef163e3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:38.485088 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea62e71c-aaef-4d34-8ad5-4342ef163e3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:38.485673 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea62e71c-aaef-4d34-8ad5-4342ef163e3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:38.639337 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f4a3d0d0-bf35-4c8b-964f-0ce083f5a197 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:38.647407 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f4a3d0d0-bf35-4c8b-964f-0ce083f5a197 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.359617 Nov 23 07:43:38.649172 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 30/60] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:38 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:43:38.654577 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-da0b394f-501a-4d69-81db-281dbdaa9b4a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:38.655776 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-da0b394f-501a-4d69-81db-281dbdaa9b4a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:38.663199 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-da0b394f-501a-4d69-81db-281dbdaa9b4a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:38.663905 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-da0b394f-501a-4d69-81db-281dbdaa9b4a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:38.664728 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-da0b394f-501a-4d69-81db-281dbdaa9b4a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:38.665251 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-da0b394f-501a-4d69-81db-281dbdaa9b4a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:38.795593 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ea62e71c-aaef-4d34-8ad5-4342ef163e3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:38.805587 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ea62e71c-aaef-4d34-8ad5-4342ef163e3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:38.806112 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ea62e71c-aaef-4d34-8ad5-4342ef163e3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:38.807555 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ea62e71c-aaef-4d34-8ad5-4342ef163e3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1406 microversion: 2.20 time: 0.338000 Nov 23 07:43:38.808273 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 31/61] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:38 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1406 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:43:38.813077 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-23627113-3680-49ce-828a-6958a0d08278 req-55464fed-d7f1-4383-baa2-65a30cb38414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb841a35-6344-43a0-85d2-6de8116759b1", "tag": "8b4fce4b-5f2b-4eea-8335-5d57ac70511e"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:43:38.814629 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:43:38.814629 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:43:38.822313 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-23627113-3680-49ce-828a-6958a0d08278 req-55464fed-d7f1-4383-baa2-65a30cb38414 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:38.822640 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-23627113-3680-49ce-828a-6958a0d08278 req-55464fed-d7f1-4383-baa2-65a30cb38414 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:38.829505 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-da0b394f-501a-4d69-81db-281dbdaa9b4a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:38.840053 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-23627113-3680-49ce-828a-6958a0d08278 req-55464fed-d7f1-4383-baa2-65a30cb38414 service nova] Creating event network-changed:8b4fce4b-5f2b-4eea-8335-5d57ac70511e for instance bb841a35-6344-43a0-85d2-6de8116759b1 on hv-cinder-80403 Nov 23 07:43:38.841436 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-da0b394f-501a-4d69-81db-281dbdaa9b4a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1321 microversion: 2.1 time: 0.190670 Nov 23 07:43:38.842853 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 31/62] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:38 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:38.846158 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-23627113-3680-49ce-828a-6958a0d08278 req-55464fed-d7f1-4383-baa2-65a30cb38414 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036375 Nov 23 07:43:38.847206 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 32/63] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:43:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:43:38.965903 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-401f809f-c1fd-4b5c-8ac6-1cced240463b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:38.966518 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-401f809f-c1fd-4b5c-8ac6-1cced240463b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:38.972340 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-401f809f-c1fd-4b5c-8ac6-1cced240463b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:38.972806 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-401f809f-c1fd-4b5c-8ac6-1cced240463b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:38.973628 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-401f809f-c1fd-4b5c-8ac6-1cced240463b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:38.974088 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-401f809f-c1fd-4b5c-8ac6-1cced240463b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:39.117878 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-401f809f-c1fd-4b5c-8ac6-1cced240463b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:39.125201 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-401f809f-c1fd-4b5c-8ac6-1cced240463b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1315 microversion: 2.1 time: 0.163523 Nov 23 07:43:39.125782 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 32/64] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:38 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:39.666045 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-372d3218-f776-4ebd-817e-4ede904d4d59 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:39.666829 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-372d3218-f776-4ebd-817e-4ede904d4d59 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:39.672938 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-372d3218-f776-4ebd-817e-4ede904d4d59 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:39.673394 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-372d3218-f776-4ebd-817e-4ede904d4d59 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:39.674212 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-372d3218-f776-4ebd-817e-4ede904d4d59 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:39.674656 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-372d3218-f776-4ebd-817e-4ede904d4d59 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:39.814054 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-372d3218-f776-4ebd-817e-4ede904d4d59 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:39.821908 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-372d3218-f776-4ebd-817e-4ede904d4d59 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.160082 Nov 23 07:43:39.822551 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 33/65] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:39 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:39.830784 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-b4d2641d-a7b9-4ec2-9bd2-1bf0e96577c8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:39.831816 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-b4d2641d-a7b9-4ec2-9bd2-1bf0e96577c8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:39.840402 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b4d2641d-a7b9-4ec2-9bd2-1bf0e96577c8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:39.840824 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b4d2641d-a7b9-4ec2-9bd2-1bf0e96577c8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:39.841606 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b4d2641d-a7b9-4ec2-9bd2-1bf0e96577c8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:39.842063 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b4d2641d-a7b9-4ec2-9bd2-1bf0e96577c8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:39.862238 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-2841a2fa-889a-4b2e-bce8-b919f7e21a07 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:39.862947 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-2841a2fa-889a-4b2e-bce8-b919f7e21a07 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:39.868989 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2841a2fa-889a-4b2e-bce8-b919f7e21a07 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:39.869808 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2841a2fa-889a-4b2e-bce8-b919f7e21a07 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:39.870668 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2841a2fa-889a-4b2e-bce8-b919f7e21a07 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:39.871180 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2841a2fa-889a-4b2e-bce8-b919f7e21a07 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:40.145618 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2841a2fa-889a-4b2e-bce8-b919f7e21a07 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:40.158066 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-2841a2fa-889a-4b2e-bce8-b919f7e21a07 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1321 microversion: 2.1 time: 0.299241 Nov 23 07:43:40.168909 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 34/66] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:39 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:43:40.174046 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-365a9e88-5992-45e2-9b3c-2f58dc6008f5 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:40.174349 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-365a9e88-5992-45e2-9b3c-2f58dc6008f5 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:40.181723 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-365a9e88-5992-45e2-9b3c-2f58dc6008f5 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:40.182794 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-365a9e88-5992-45e2-9b3c-2f58dc6008f5 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:40.183563 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-365a9e88-5992-45e2-9b3c-2f58dc6008f5 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:40.184263 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-365a9e88-5992-45e2-9b3c-2f58dc6008f5 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:40.370910 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-b4d2641d-a7b9-4ec2-9bd2-1bf0e96577c8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:40.382111 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-b4d2641d-a7b9-4ec2-9bd2-1bf0e96577c8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:40.384121 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-b4d2641d-a7b9-4ec2-9bd2-1bf0e96577c8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:40.386712 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-b4d2641d-a7b9-4ec2-9bd2-1bf0e96577c8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1406 microversion: 2.20 time: 0.562169 Nov 23 07:43:40.398862 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:39 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1406 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:40.599764 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-365a9e88-5992-45e2-9b3c-2f58dc6008f5 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:40.610839 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-365a9e88-5992-45e2-9b3c-2f58dc6008f5 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1315 microversion: 2.1 time: 0.444804 Nov 23 07:43:40.611437 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 35/68] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:40 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:40.840384 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-23a562f6-1b17-46bc-aa74-dfabf5ae107c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:40.841012 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-23a562f6-1b17-46bc-aa74-dfabf5ae107c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:40.847060 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-23a562f6-1b17-46bc-aa74-dfabf5ae107c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:40.847611 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-23a562f6-1b17-46bc-aa74-dfabf5ae107c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:40.848334 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-23a562f6-1b17-46bc-aa74-dfabf5ae107c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:40.848773 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-23a562f6-1b17-46bc-aa74-dfabf5ae107c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:40.987142 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-23a562f6-1b17-46bc-aa74-dfabf5ae107c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:40.994505 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-23a562f6-1b17-46bc-aa74-dfabf5ae107c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.158299 Nov 23 07:43:40.995591 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 34/69] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:40 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:41.174532 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-78f97c0d-ead5-4606-b4a0-be9de1c5875e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:41.175243 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-78f97c0d-ead5-4606-b4a0-be9de1c5875e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:41.181020 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-78f97c0d-ead5-4606-b4a0-be9de1c5875e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:41.182063 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-78f97c0d-ead5-4606-b4a0-be9de1c5875e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:41.182933 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-78f97c0d-ead5-4606-b4a0-be9de1c5875e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:41.183380 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-78f97c0d-ead5-4606-b4a0-be9de1c5875e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:41.332550 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-78f97c0d-ead5-4606-b4a0-be9de1c5875e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:41.340100 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-78f97c0d-ead5-4606-b4a0-be9de1c5875e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1321 microversion: 2.1 time: 0.169244 Nov 23 07:43:41.340713 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 36/70] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:41 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:41.405409 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-1ee3a955-c6bc-447f-8eed-dfde7f66079f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:41.406145 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-1ee3a955-c6bc-447f-8eed-dfde7f66079f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:41.412381 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1ee3a955-c6bc-447f-8eed-dfde7f66079f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:41.412824 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1ee3a955-c6bc-447f-8eed-dfde7f66079f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:41.413950 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1ee3a955-c6bc-447f-8eed-dfde7f66079f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:41.414374 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1ee3a955-c6bc-447f-8eed-dfde7f66079f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:41.598029 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-1ee3a955-c6bc-447f-8eed-dfde7f66079f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:41.606427 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-1ee3a955-c6bc-447f-8eed-dfde7f66079f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:41.607960 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-1ee3a955-c6bc-447f-8eed-dfde7f66079f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:41.609109 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-1ee3a955-c6bc-447f-8eed-dfde7f66079f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1406 microversion: 2.20 time: 0.208196 Nov 23 07:43:41.609669 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 35/71] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:41 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:41.628130 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e21eff1e-dfc5-4dc2-a180-a9f082d2d98b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:41.628754 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e21eff1e-dfc5-4dc2-a180-a9f082d2d98b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:41.634683 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e21eff1e-dfc5-4dc2-a180-a9f082d2d98b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:41.635140 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e21eff1e-dfc5-4dc2-a180-a9f082d2d98b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:41.636559 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e21eff1e-dfc5-4dc2-a180-a9f082d2d98b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:41.636997 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e21eff1e-dfc5-4dc2-a180-a9f082d2d98b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:41.791046 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-e21eff1e-dfc5-4dc2-a180-a9f082d2d98b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:41.799226 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e21eff1e-dfc5-4dc2-a180-a9f082d2d98b tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1315 microversion: 2.1 time: 0.174827 Nov 23 07:43:41.799811 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 37/72] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:41 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:42.012475 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-4b66f180-c47f-4b08-a385-ebd8cc0024e3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:42.013033 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-4b66f180-c47f-4b08-a385-ebd8cc0024e3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:42.019590 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4b66f180-c47f-4b08-a385-ebd8cc0024e3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:42.020086 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4b66f180-c47f-4b08-a385-ebd8cc0024e3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:42.020905 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4b66f180-c47f-4b08-a385-ebd8cc0024e3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:42.021344 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4b66f180-c47f-4b08-a385-ebd8cc0024e3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:42.245374 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-4b66f180-c47f-4b08-a385-ebd8cc0024e3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:42.252621 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-4b66f180-c47f-4b08-a385-ebd8cc0024e3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.244030 Nov 23 07:43:42.253196 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 36/73] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:42 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:42.358242 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-cd2832df-c220-464f-8d4e-0d6444e2341e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:42.358936 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-cd2832df-c220-464f-8d4e-0d6444e2341e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:42.365061 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cd2832df-c220-464f-8d4e-0d6444e2341e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:42.365590 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cd2832df-c220-464f-8d4e-0d6444e2341e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:42.366476 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cd2832df-c220-464f-8d4e-0d6444e2341e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:42.366998 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cd2832df-c220-464f-8d4e-0d6444e2341e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:42.501619 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-cd2832df-c220-464f-8d4e-0d6444e2341e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:42.509497 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-cd2832df-c220-464f-8d4e-0d6444e2341e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1321 microversion: 2.1 time: 0.155879 Nov 23 07:43:42.510102 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 38/74] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:42 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:42.627313 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-041f3452-0d38-4115-bcf8-e5068147e6ab tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:42.627963 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-041f3452-0d38-4115-bcf8-e5068147e6ab tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:42.634244 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-041f3452-0d38-4115-bcf8-e5068147e6ab tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:42.634945 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-041f3452-0d38-4115-bcf8-e5068147e6ab tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:42.636303 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-041f3452-0d38-4115-bcf8-e5068147e6ab tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:42.636742 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-041f3452-0d38-4115-bcf8-e5068147e6ab tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:42.774642 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-041f3452-0d38-4115-bcf8-e5068147e6ab tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:42.783013 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-041f3452-0d38-4115-bcf8-e5068147e6ab tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:42.784903 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-041f3452-0d38-4115-bcf8-e5068147e6ab tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:42.786287 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-041f3452-0d38-4115-bcf8-e5068147e6ab tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1406 microversion: 2.20 time: 0.162624 Nov 23 07:43:42.787000 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 37/75] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:42 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:42.816624 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d63dede3-9a0f-4eb8-b9ca-90103aa4cc36 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:42.817443 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d63dede3-9a0f-4eb8-b9ca-90103aa4cc36 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:42.829226 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d63dede3-9a0f-4eb8-b9ca-90103aa4cc36 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:42.829686 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d63dede3-9a0f-4eb8-b9ca-90103aa4cc36 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:42.830556 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d63dede3-9a0f-4eb8-b9ca-90103aa4cc36 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:42.831171 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d63dede3-9a0f-4eb8-b9ca-90103aa4cc36 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:42.992739 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d63dede3-9a0f-4eb8-b9ca-90103aa4cc36 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:43.000477 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d63dede3-9a0f-4eb8-b9ca-90103aa4cc36 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1315 microversion: 2.1 time: 0.187723 Nov 23 07:43:43.001064 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 39/76] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:42 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:43.269662 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-296e8af0-a052-4dc2-bba0-c664a8a9947b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:43.270294 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-296e8af0-a052-4dc2-bba0-c664a8a9947b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:43.276707 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-296e8af0-a052-4dc2-bba0-c664a8a9947b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:43.277164 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-296e8af0-a052-4dc2-bba0-c664a8a9947b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:43.277980 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-296e8af0-a052-4dc2-bba0-c664a8a9947b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:43.278409 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-296e8af0-a052-4dc2-bba0-c664a8a9947b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:43.451121 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-296e8af0-a052-4dc2-bba0-c664a8a9947b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:43.466524 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-296e8af0-a052-4dc2-bba0-c664a8a9947b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.200187 Nov 23 07:43:43.466913 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 38/77] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:43 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:43.529119 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-57546a8b-828d-4c2a-b77d-5c3a5d61855f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:43.529835 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-57546a8b-828d-4c2a-b77d-5c3a5d61855f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:43.539608 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-57546a8b-828d-4c2a-b77d-5c3a5d61855f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:43.541098 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-57546a8b-828d-4c2a-b77d-5c3a5d61855f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:43.541217 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-57546a8b-828d-4c2a-b77d-5c3a5d61855f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:43.541751 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-57546a8b-828d-4c2a-b77d-5c3a5d61855f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:43.804611 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ca0b1c5d-9c7e-4472-9c7a-4204d32686b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:43.805266 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ca0b1c5d-9c7e-4472-9c7a-4204d32686b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:43.822063 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ca0b1c5d-9c7e-4472-9c7a-4204d32686b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:43.823044 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ca0b1c5d-9c7e-4472-9c7a-4204d32686b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:43.824240 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ca0b1c5d-9c7e-4472-9c7a-4204d32686b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:43.824739 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ca0b1c5d-9c7e-4472-9c7a-4204d32686b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:43.906989 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-57546a8b-828d-4c2a-b77d-5c3a5d61855f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:43.919689 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-57546a8b-828d-4c2a-b77d-5c3a5d61855f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1321 microversion: 2.1 time: 0.396356 Nov 23 07:43:43.920295 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 40/78] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:43 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:44.017938 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-65b4d6f0-8722-4a4a-ba85-91d5529a6abe tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:44.018564 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-65b4d6f0-8722-4a4a-ba85-91d5529a6abe tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:44.024568 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-65b4d6f0-8722-4a4a-ba85-91d5529a6abe tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:44.025027 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-65b4d6f0-8722-4a4a-ba85-91d5529a6abe tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:44.025844 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-65b4d6f0-8722-4a4a-ba85-91d5529a6abe tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:44.026823 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-65b4d6f0-8722-4a4a-ba85-91d5529a6abe tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:44.310533 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ca0b1c5d-9c7e-4472-9c7a-4204d32686b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:44.319193 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ca0b1c5d-9c7e-4472-9c7a-4204d32686b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:44.320699 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ca0b1c5d-9c7e-4472-9c7a-4204d32686b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:44.321841 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ca0b1c5d-9c7e-4472-9c7a-4204d32686b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1406 microversion: 2.20 time: 0.521232 Nov 23 07:43:44.322763 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 39/79] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:43 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1406 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:44.462847 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-65b4d6f0-8722-4a4a-ba85-91d5529a6abe tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:44.476962 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-65b4d6f0-8722-4a4a-ba85-91d5529a6abe tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1315 microversion: 2.1 time: 0.461408 Nov 23 07:43:44.480468 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 41/80] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:44 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:43:44.497580 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-87a89a22-8465-473d-9597-a477e4fa6afc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:44.498580 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-87a89a22-8465-473d-9597-a477e4fa6afc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:44.506788 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-87a89a22-8465-473d-9597-a477e4fa6afc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:44.507224 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-87a89a22-8465-473d-9597-a477e4fa6afc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:44.508343 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-87a89a22-8465-473d-9597-a477e4fa6afc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:44.509514 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-87a89a22-8465-473d-9597-a477e4fa6afc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:44.937412 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-48079735-d202-4a48-ad04-f4b9a077c116 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:44.938584 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-48079735-d202-4a48-ad04-f4b9a077c116 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:44.946467 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-48079735-d202-4a48-ad04-f4b9a077c116 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:44.949008 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-48079735-d202-4a48-ad04-f4b9a077c116 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:44.953292 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-48079735-d202-4a48-ad04-f4b9a077c116 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:44.954087 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-48079735-d202-4a48-ad04-f4b9a077c116 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:45.339045 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-48079735-d202-4a48-ad04-f4b9a077c116 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:45.352976 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-87a89a22-8465-473d-9597-a477e4fa6afc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:45.354166 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-48079735-d202-4a48-ad04-f4b9a077c116 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1321 microversion: 2.1 time: 0.419570 Nov 23 07:43:45.355480 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 42/81] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:44 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1321 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:45.374719 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-87a89a22-8465-473d-9597-a477e4fa6afc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.873752 Nov 23 07:43:45.376926 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-36adda6b-2538-4830-ba51-fddf4a8f33ae tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:45.376926 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-36adda6b-2538-4830-ba51-fddf4a8f33ae tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:45.378680 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 40/82] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:44 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:45.402978 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-36adda6b-2538-4830-ba51-fddf4a8f33ae tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:45.403574 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-36adda6b-2538-4830-ba51-fddf4a8f33ae tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:45.404441 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-36adda6b-2538-4830-ba51-fddf4a8f33ae tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:45.408094 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-36adda6b-2538-4830-ba51-fddf4a8f33ae tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:45.504794 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d009701f-3c3f-4e39-ba6d-8a79f64d03f4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:45.505276 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d009701f-3c3f-4e39-ba6d-8a79f64d03f4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:45.515089 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d009701f-3c3f-4e39-ba6d-8a79f64d03f4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:45.515787 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d009701f-3c3f-4e39-ba6d-8a79f64d03f4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:45.516592 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d009701f-3c3f-4e39-ba6d-8a79f64d03f4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:45.522444 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d009701f-3c3f-4e39-ba6d-8a79f64d03f4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:45.685862 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-36adda6b-2538-4830-ba51-fddf4a8f33ae tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:45.723166 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-36adda6b-2538-4830-ba51-fddf4a8f33ae tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:45.727730 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-36adda6b-2538-4830-ba51-fddf4a8f33ae tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:45.729252 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-36adda6b-2538-4830-ba51-fddf4a8f33ae tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1406 microversion: 2.20 time: 0.372302 Nov 23 07:43:45.730631 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 43/83] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:45 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1406 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:45.894745 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d009701f-3c3f-4e39-ba6d-8a79f64d03f4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:45.904099 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d009701f-3c3f-4e39-ba6d-8a79f64d03f4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1501 microversion: 2.1 time: 0.413450 Nov 23 07:43:45.918260 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 41/84] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:45 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1501 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:43:46.397438 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-01169e88-e522-4864-a1aa-c272af9d86b2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:46.398088 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-01169e88-e522-4864-a1aa-c272af9d86b2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:46.405401 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-01169e88-e522-4864-a1aa-c272af9d86b2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:46.407612 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-01169e88-e522-4864-a1aa-c272af9d86b2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:46.408471 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-01169e88-e522-4864-a1aa-c272af9d86b2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:46.408954 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-01169e88-e522-4864-a1aa-c272af9d86b2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:46.420112 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-a1bbd703-60ec-4c2d-ac52-77fbe774b495 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:46.420724 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-a1bbd703-60ec-4c2d-ac52-77fbe774b495 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:46.432414 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a1bbd703-60ec-4c2d-ac52-77fbe774b495 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:46.433885 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a1bbd703-60ec-4c2d-ac52-77fbe774b495 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:46.435510 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a1bbd703-60ec-4c2d-ac52-77fbe774b495 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:46.436535 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a1bbd703-60ec-4c2d-ac52-77fbe774b495 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:46.633208 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-01169e88-e522-4864-a1aa-c272af9d86b2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:46.642876 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-01169e88-e522-4864-a1aa-c272af9d86b2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.253906 Nov 23 07:43:46.643890 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 44/85] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:46 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:46.730649 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a1bbd703-60ec-4c2d-ac52-77fbe774b495 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:46.738756 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-a1bbd703-60ec-4c2d-ac52-77fbe774b495 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1321 microversion: 2.1 time: 0.323136 Nov 23 07:43:46.754021 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4cd60997-ab0b-4e42-a93e-63e08f93e94f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:46.754639 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4cd60997-ab0b-4e42-a93e-63e08f93e94f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:46.761397 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 42/86] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:46 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:46.764530 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4cd60997-ab0b-4e42-a93e-63e08f93e94f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:46.765339 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4cd60997-ab0b-4e42-a93e-63e08f93e94f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:46.776285 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4cd60997-ab0b-4e42-a93e-63e08f93e94f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:46.781400 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4cd60997-ab0b-4e42-a93e-63e08f93e94f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:47.036820 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-4cd60997-ab0b-4e42-a93e-63e08f93e94f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:47.054906 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-4cd60997-ab0b-4e42-a93e-63e08f93e94f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:47.058289 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-4cd60997-ab0b-4e42-a93e-63e08f93e94f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:47.059925 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4cd60997-ab0b-4e42-a93e-63e08f93e94f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1406 microversion: 2.20 time: 0.309514 Nov 23 07:43:47.076789 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 45/87] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:46 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1406 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:47.454829 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-cac2c72e-8463-4938-b5c4-152623bfeaa4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b835869-0a1a-4339-bc4e-2a6c9c0c9948"}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:43:47.456766 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-cac2c72e-8463-4938-b5c4-152623bfeaa4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:47.463116 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cac2c72e-8463-4938-b5c4-152623bfeaa4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:47.464129 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cac2c72e-8463-4938-b5c4-152623bfeaa4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:47.464917 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cac2c72e-8463-4938-b5c4-152623bfeaa4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:47.465515 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cac2c72e-8463-4938-b5c4-152623bfeaa4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:47.661964 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-7e85f64d-ab9a-42ed-8b46-535964b6f01b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:47.672265 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-7e85f64d-ab9a-42ed-8b46-535964b6f01b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:47.685575 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7e85f64d-ab9a-42ed-8b46-535964b6f01b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:47.685575 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7e85f64d-ab9a-42ed-8b46-535964b6f01b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:47.686160 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7e85f64d-ab9a-42ed-8b46-535964b6f01b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:47.686663 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7e85f64d-ab9a-42ed-8b46-535964b6f01b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:47.863140 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-cac2c72e-8463-4938-b5c4-152623bfeaa4 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "POST /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412101 Nov 23 07:43:47.863939 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 43/88] 10.222.0.48 () {60 vars in 1322 bytes} [Tue Nov 23 07:43:47 2021] POST /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:43:47.871372 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-befb2d5b-34f6-4362-a6d0-6605377d0f0e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:47.872421 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-befb2d5b-34f6-4362-a6d0-6605377d0f0e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:47.880797 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-befb2d5b-34f6-4362-a6d0-6605377d0f0e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:47.881689 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-befb2d5b-34f6-4362-a6d0-6605377d0f0e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:47.882829 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-befb2d5b-34f6-4362-a6d0-6605377d0f0e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:47.883715 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-befb2d5b-34f6-4362-a6d0-6605377d0f0e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:47.928044 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-7e85f64d-ab9a-42ed-8b46-535964b6f01b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:47.939650 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-7e85f64d-ab9a-42ed-8b46-535964b6f01b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.281866 Nov 23 07:43:47.941343 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 46/89] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:47 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:43:48.082586 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-3bf0cef6-e658-4d93-aaeb-653f32294b73 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:48.083769 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-3bf0cef6-e658-4d93-aaeb-653f32294b73 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:48.085747 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-befb2d5b-34f6-4362-a6d0-6605377d0f0e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:48.093624 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3bf0cef6-e658-4d93-aaeb-653f32294b73 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:48.094125 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3bf0cef6-e658-4d93-aaeb-653f32294b73 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:48.097125 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-befb2d5b-34f6-4362-a6d0-6605377d0f0e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1321 microversion: 2.1 time: 0.231018 Nov 23 07:43:48.098050 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3bf0cef6-e658-4d93-aaeb-653f32294b73 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:48.099803 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3bf0cef6-e658-4d93-aaeb-653f32294b73 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:48.108570 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 44/90] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:47 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:48.377591 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-3bf0cef6-e658-4d93-aaeb-653f32294b73 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:48.420347 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-3bf0cef6-e658-4d93-aaeb-653f32294b73 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:48.424029 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-3bf0cef6-e658-4d93-aaeb-653f32294b73 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:48.431772 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-3bf0cef6-e658-4d93-aaeb-653f32294b73 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1406 microversion: 2.20 time: 0.352799 Nov 23 07:43:48.435007 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 47/91] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:48 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:48.958579 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-2a0feaf0-218b-4510-80b2-71b55a49428d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:48.959322 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-2a0feaf0-218b-4510-80b2-71b55a49428d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:48.970881 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2a0feaf0-218b-4510-80b2-71b55a49428d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:48.971501 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2a0feaf0-218b-4510-80b2-71b55a49428d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:48.973753 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2a0feaf0-218b-4510-80b2-71b55a49428d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:48.975704 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2a0feaf0-218b-4510-80b2-71b55a49428d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:49.116150 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-0336f164-53b8-4d66-a9c9-ecbc57e74678 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:49.117082 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-0336f164-53b8-4d66-a9c9-ecbc57e74678 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:49.125126 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0336f164-53b8-4d66-a9c9-ecbc57e74678 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:49.125396 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0336f164-53b8-4d66-a9c9-ecbc57e74678 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:49.134758 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0336f164-53b8-4d66-a9c9-ecbc57e74678 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:49.138726 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0336f164-53b8-4d66-a9c9-ecbc57e74678 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:49.195646 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-2a0feaf0-218b-4510-80b2-71b55a49428d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:49.206989 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-2a0feaf0-218b-4510-80b2-71b55a49428d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.252223 Nov 23 07:43:49.208155 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 45/92] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:48 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:49.324307 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-0336f164-53b8-4d66-a9c9-ecbc57e74678 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:49.332703 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-0336f164-53b8-4d66-a9c9-ecbc57e74678 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1321 microversion: 2.1 time: 0.221025 Nov 23 07:43:49.333253 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 48/93] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:49 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:43:49.453583 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-75593067-058a-4961-aafb-6b1e69bbcceb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:49.454320 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-75593067-058a-4961-aafb-6b1e69bbcceb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:49.461531 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-75593067-058a-4961-aafb-6b1e69bbcceb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:49.462231 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-75593067-058a-4961-aafb-6b1e69bbcceb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:49.463289 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-75593067-058a-4961-aafb-6b1e69bbcceb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:49.463832 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-75593067-058a-4961-aafb-6b1e69bbcceb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:49.609408 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-75593067-058a-4961-aafb-6b1e69bbcceb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:49.619209 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-75593067-058a-4961-aafb-6b1e69bbcceb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:49.619536 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-75593067-058a-4961-aafb-6b1e69bbcceb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:49.620846 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-75593067-058a-4961-aafb-6b1e69bbcceb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1406 microversion: 2.20 time: 0.171492 Nov 23 07:43:49.631768 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 46/94] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:49 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:50.226231 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-3ac07ee7-374a-41e2-9a41-65696e7b2b26 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:50.227489 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-3ac07ee7-374a-41e2-9a41-65696e7b2b26 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:50.236989 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3ac07ee7-374a-41e2-9a41-65696e7b2b26 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:50.239033 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3ac07ee7-374a-41e2-9a41-65696e7b2b26 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:50.240257 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3ac07ee7-374a-41e2-9a41-65696e7b2b26 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:50.240815 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3ac07ee7-374a-41e2-9a41-65696e7b2b26 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:50.353790 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-fd38adde-5c5a-4d12-9911-1bc1df0eabf7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:50.355392 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-fd38adde-5c5a-4d12-9911-1bc1df0eabf7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:50.364421 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fd38adde-5c5a-4d12-9911-1bc1df0eabf7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:50.367107 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fd38adde-5c5a-4d12-9911-1bc1df0eabf7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:50.368016 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fd38adde-5c5a-4d12-9911-1bc1df0eabf7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:50.371210 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fd38adde-5c5a-4d12-9911-1bc1df0eabf7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:50.451750 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-3ac07ee7-374a-41e2-9a41-65696e7b2b26 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:50.469683 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-3ac07ee7-374a-41e2-9a41-65696e7b2b26 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.248188 Nov 23 07:43:50.470655 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 49/95] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:50 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:50.498057 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-7f7930d8-2ed4-49ba-ad77-5e1eff5bcaaa req-c711befc-ecb9-45b4-a21e-12d0a93867d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9df126-b886-4cb5-88f0-20dc6e22dbe1", "name": "network-vif-plugged", "status": "completed", "tag": "e60ee95d-4ae8-48a9-b92b-e6e28e265d71"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:43:50.498057 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:43:50.498057 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:43:50.504430 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-7f7930d8-2ed4-49ba-ad77-5e1eff5bcaaa req-c711befc-ecb9-45b4-a21e-12d0a93867d4 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:50.505037 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-7f7930d8-2ed4-49ba-ad77-5e1eff5bcaaa req-c711befc-ecb9-45b4-a21e-12d0a93867d4 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:50.518659 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-7f7930d8-2ed4-49ba-ad77-5e1eff5bcaaa req-c711befc-ecb9-45b4-a21e-12d0a93867d4 service nova] Creating event network-vif-plugged:e60ee95d-4ae8-48a9-b92b-e6e28e265d71 for instance 6b9df126-b886-4cb5-88f0-20dc6e22dbe1 on hv-cinder-80403 Nov 23 07:43:50.526752 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-7f7930d8-2ed4-49ba-ad77-5e1eff5bcaaa req-c711befc-ecb9-45b4-a21e-12d0a93867d4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047133 Nov 23 07:43:50.527806 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 50/96] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:43:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:43:50.641153 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-bac9cd10-4ab2-4922-84ef-99ee129b3a8a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:50.641906 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-bac9cd10-4ab2-4922-84ef-99ee129b3a8a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:50.652160 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bac9cd10-4ab2-4922-84ef-99ee129b3a8a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:50.654244 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bac9cd10-4ab2-4922-84ef-99ee129b3a8a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:50.670514 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-fd38adde-5c5a-4d12-9911-1bc1df0eabf7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:50.676405 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bac9cd10-4ab2-4922-84ef-99ee129b3a8a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:50.677589 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bac9cd10-4ab2-4922-84ef-99ee129b3a8a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:50.679853 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-fd38adde-5c5a-4d12-9911-1bc1df0eabf7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1321 microversion: 2.1 time: 0.329657 Nov 23 07:43:50.681293 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 47/97] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:50 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:50.919573 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-bac9cd10-4ab2-4922-84ef-99ee129b3a8a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:50.929000 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-bac9cd10-4ab2-4922-84ef-99ee129b3a8a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:50.931243 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-bac9cd10-4ab2-4922-84ef-99ee129b3a8a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:50.933457 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-bac9cd10-4ab2-4922-84ef-99ee129b3a8a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1406 microversion: 2.20 time: 0.297267 Nov 23 07:43:50.934584 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 51/98] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:50 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1406 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:51.486585 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d2744bba-8bfb-4a7e-a69e-8babdb5bcb08 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:51.487997 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d2744bba-8bfb-4a7e-a69e-8babdb5bcb08 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:51.496926 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d2744bba-8bfb-4a7e-a69e-8babdb5bcb08 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:51.497688 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d2744bba-8bfb-4a7e-a69e-8babdb5bcb08 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:51.502543 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d2744bba-8bfb-4a7e-a69e-8babdb5bcb08 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:51.503276 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d2744bba-8bfb-4a7e-a69e-8babdb5bcb08 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:51.700156 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-66feaeac-5a70-46ce-bdd4-e9a8b0d92cce tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:51.700766 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-66feaeac-5a70-46ce-bdd4-e9a8b0d92cce tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:51.706820 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-66feaeac-5a70-46ce-bdd4-e9a8b0d92cce tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:51.707383 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-66feaeac-5a70-46ce-bdd4-e9a8b0d92cce tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:51.708175 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-66feaeac-5a70-46ce-bdd4-e9a8b0d92cce tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:51.708939 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-66feaeac-5a70-46ce-bdd4-e9a8b0d92cce tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:51.747380 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d2744bba-8bfb-4a7e-a69e-8babdb5bcb08 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:51.762472 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d2744bba-8bfb-4a7e-a69e-8babdb5bcb08 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.277999 Nov 23 07:43:51.764123 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 48/99] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:51 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:51.883842 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-66feaeac-5a70-46ce-bdd4-e9a8b0d92cce tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:51.891640 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-66feaeac-5a70-46ce-bdd4-e9a8b0d92cce tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1321 microversion: 2.1 time: 0.195271 Nov 23 07:43:51.892231 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 52/100] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:51 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:51.951535 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c36ff7f4-1768-42a7-945a-4dd518b5b4fd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:51.952152 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c36ff7f4-1768-42a7-945a-4dd518b5b4fd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:51.958096 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c36ff7f4-1768-42a7-945a-4dd518b5b4fd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:51.958550 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c36ff7f4-1768-42a7-945a-4dd518b5b4fd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:51.959410 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c36ff7f4-1768-42a7-945a-4dd518b5b4fd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:51.959852 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c36ff7f4-1768-42a7-945a-4dd518b5b4fd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:52.210961 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c36ff7f4-1768-42a7-945a-4dd518b5b4fd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:52.226454 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c36ff7f4-1768-42a7-945a-4dd518b5b4fd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:52.248421 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c36ff7f4-1768-42a7-945a-4dd518b5b4fd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:52.249661 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c36ff7f4-1768-42a7-945a-4dd518b5b4fd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1406 microversion: 2.20 time: 0.301947 Nov 23 07:43:52.263741 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 49/101] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:51 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1406 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:52.780603 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-77f4c7e3-370d-4fdf-87ed-b7a2e40e2afc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:52.782410 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-77f4c7e3-370d-4fdf-87ed-b7a2e40e2afc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:52.789356 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-77f4c7e3-370d-4fdf-87ed-b7a2e40e2afc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:52.789834 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-77f4c7e3-370d-4fdf-87ed-b7a2e40e2afc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:52.790625 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-77f4c7e3-370d-4fdf-87ed-b7a2e40e2afc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:52.791237 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-77f4c7e3-370d-4fdf-87ed-b7a2e40e2afc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:52.908732 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d68a35c9-1d83-466f-ba5b-f95eaafcd33e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:52.914159 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d68a35c9-1d83-466f-ba5b-f95eaafcd33e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:52.923130 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d68a35c9-1d83-466f-ba5b-f95eaafcd33e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:52.923745 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d68a35c9-1d83-466f-ba5b-f95eaafcd33e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:52.924780 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d68a35c9-1d83-466f-ba5b-f95eaafcd33e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:52.925496 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d68a35c9-1d83-466f-ba5b-f95eaafcd33e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:53.007912 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-77f4c7e3-370d-4fdf-87ed-b7a2e40e2afc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:53.019150 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-77f4c7e3-370d-4fdf-87ed-b7a2e40e2afc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.241998 Nov 23 07:43:53.020096 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 53/102] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:52 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:53.110486 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d68a35c9-1d83-466f-ba5b-f95eaafcd33e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:53.119623 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d68a35c9-1d83-466f-ba5b-f95eaafcd33e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1321 microversion: 2.1 time: 0.214557 Nov 23 07:43:53.120398 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 50/103] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:52 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:53.269919 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4ca8e329-2062-4dfb-8b7d-ce944cefda86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:53.270486 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4ca8e329-2062-4dfb-8b7d-ce944cefda86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:53.276881 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4ca8e329-2062-4dfb-8b7d-ce944cefda86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:53.277338 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4ca8e329-2062-4dfb-8b7d-ce944cefda86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:53.278166 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4ca8e329-2062-4dfb-8b7d-ce944cefda86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:53.278598 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4ca8e329-2062-4dfb-8b7d-ce944cefda86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:53.430663 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-4ca8e329-2062-4dfb-8b7d-ce944cefda86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:53.439759 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-4ca8e329-2062-4dfb-8b7d-ce944cefda86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:53.441580 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-4ca8e329-2062-4dfb-8b7d-ce944cefda86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:53.442450 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4ca8e329-2062-4dfb-8b7d-ce944cefda86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1406 microversion: 2.20 time: 0.176794 Nov 23 07:43:53.453510 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 54/104] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:53 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:54.036376 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-babe3d2c-276f-4967-861a-9a8e5d20e8bc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:54.036918 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-babe3d2c-276f-4967-861a-9a8e5d20e8bc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:54.044301 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-babe3d2c-276f-4967-861a-9a8e5d20e8bc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:54.044748 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-babe3d2c-276f-4967-861a-9a8e5d20e8bc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:54.045593 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-babe3d2c-276f-4967-861a-9a8e5d20e8bc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:54.046057 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-babe3d2c-276f-4967-861a-9a8e5d20e8bc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:54.139312 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ca583b64-d75e-44a1-85c0-4219b6142031 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:54.140595 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ca583b64-d75e-44a1-85c0-4219b6142031 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:54.149223 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ca583b64-d75e-44a1-85c0-4219b6142031 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:54.149513 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ca583b64-d75e-44a1-85c0-4219b6142031 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:54.150567 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ca583b64-d75e-44a1-85c0-4219b6142031 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:54.151203 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ca583b64-d75e-44a1-85c0-4219b6142031 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:54.206125 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-babe3d2c-276f-4967-861a-9a8e5d20e8bc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:54.216218 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-babe3d2c-276f-4967-861a-9a8e5d20e8bc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.181090 Nov 23 07:43:54.216831 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 51/105] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:54 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:54.307127 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ca583b64-d75e-44a1-85c0-4219b6142031 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:54.314443 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ca583b64-d75e-44a1-85c0-4219b6142031 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1321 microversion: 2.1 time: 0.181460 Nov 23 07:43:54.315019 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 55/106] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:54 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:54.460419 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3b159a56-2bc4-4511-a1e0-4e86e49605b6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:54.461030 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3b159a56-2bc4-4511-a1e0-4e86e49605b6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:54.468252 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3b159a56-2bc4-4511-a1e0-4e86e49605b6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:54.468777 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3b159a56-2bc4-4511-a1e0-4e86e49605b6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:54.469535 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3b159a56-2bc4-4511-a1e0-4e86e49605b6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:54.470007 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3b159a56-2bc4-4511-a1e0-4e86e49605b6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:54.619153 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-3b159a56-2bc4-4511-a1e0-4e86e49605b6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:54.635831 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-3b159a56-2bc4-4511-a1e0-4e86e49605b6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:54.638350 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-3b159a56-2bc4-4511-a1e0-4e86e49605b6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:54.640524 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3b159a56-2bc4-4511-a1e0-4e86e49605b6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1406 microversion: 2.20 time: 0.183419 Nov 23 07:43:54.642008 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 52/107] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:54 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:55.233635 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d7e208e0-c5d0-48cc-b7b0-151a1dfc834c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:55.234290 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d7e208e0-c5d0-48cc-b7b0-151a1dfc834c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:55.240203 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d7e208e0-c5d0-48cc-b7b0-151a1dfc834c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:55.240654 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d7e208e0-c5d0-48cc-b7b0-151a1dfc834c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:55.241474 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d7e208e0-c5d0-48cc-b7b0-151a1dfc834c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:55.241957 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d7e208e0-c5d0-48cc-b7b0-151a1dfc834c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:55.331434 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5b8c0aea-c52f-4add-b65e-9865ed28a72e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:55.331953 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5b8c0aea-c52f-4add-b65e-9865ed28a72e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:55.339017 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5b8c0aea-c52f-4add-b65e-9865ed28a72e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:55.339466 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5b8c0aea-c52f-4add-b65e-9865ed28a72e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:55.340254 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5b8c0aea-c52f-4add-b65e-9865ed28a72e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:55.340685 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5b8c0aea-c52f-4add-b65e-9865ed28a72e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:55.389069 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d7e208e0-c5d0-48cc-b7b0-151a1dfc834c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:55.411177 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d7e208e0-c5d0-48cc-b7b0-151a1dfc834c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.181037 Nov 23 07:43:55.416223 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 56/108] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:55 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:55.493233 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5b8c0aea-c52f-4add-b65e-9865ed28a72e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:55.501396 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5b8c0aea-c52f-4add-b65e-9865ed28a72e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1515 microversion: 2.1 time: 0.173713 Nov 23 07:43:55.502028 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 53/109] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:55 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:43:55.520005 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8142d692-61f2-42cc-974a-b1f37e714f90 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:43:55.521006 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8142d692-61f2-42cc-974a-b1f37e714f90 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:55.527029 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8142d692-61f2-42cc-974a-b1f37e714f90 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:55.527468 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8142d692-61f2-42cc-974a-b1f37e714f90 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:55.528241 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8142d692-61f2-42cc-974a-b1f37e714f90 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:55.528667 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8142d692-61f2-42cc-974a-b1f37e714f90 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:55.596009 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.objects.instance [None req-8142d692-61f2-42cc-974a-b1f37e714f90 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lazy-loading 'flavor' on Instance uuid 6b9df126-b886-4cb5-88f0-20dc6e22dbe1 {{(pid=122786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:43:55.628486 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-f78381d9-6e66-4e97-8c08-209f40811921 req-8f049882-9739-4939-942f-3ccb83b90be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb841a35-6344-43a0-85d2-6de8116759b1", "name": "network-vif-plugged", "status": "completed", "tag": "8b4fce4b-5f2b-4eea-8335-5d57ac70511e"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:43:55.630473 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:43:55.630473 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:43:55.638246 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-f78381d9-6e66-4e97-8c08-209f40811921 req-8f049882-9739-4939-942f-3ccb83b90be6 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:55.639179 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-f78381d9-6e66-4e97-8c08-209f40811921 req-8f049882-9739-4939-942f-3ccb83b90be6 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:55.657039 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-f78381d9-6e66-4e97-8c08-209f40811921 req-8f049882-9739-4939-942f-3ccb83b90be6 service nova] Creating event network-vif-plugged:8b4fce4b-5f2b-4eea-8335-5d57ac70511e for instance bb841a35-6344-43a0-85d2-6de8116759b1 on hv-cinder-80403 Nov 23 07:43:55.662347 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-f78381d9-6e66-4e97-8c08-209f40811921 req-8f049882-9739-4939-942f-3ccb83b90be6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037323 Nov 23 07:43:55.663588 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 54/110] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:43:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:43:55.670336 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-84fb9b81-6884-4107-95a2-2fc63a07f93c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:55.671034 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-84fb9b81-6884-4107-95a2-2fc63a07f93c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:55.678467 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-84fb9b81-6884-4107-95a2-2fc63a07f93c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:55.678973 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-84fb9b81-6884-4107-95a2-2fc63a07f93c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:55.679795 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-84fb9b81-6884-4107-95a2-2fc63a07f93c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:55.680392 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-84fb9b81-6884-4107-95a2-2fc63a07f93c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:55.746605 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-8142d692-61f2-42cc-974a-b1f37e714f90 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "POST /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1/action" status: 200 len: 32 microversion: 2.1 time: 0.230282 Nov 23 07:43:55.747493 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 57/111] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:43:55 2021] POST /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1/action => generated 32 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:43:55.759798 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-2cb4c145-5138-43f9-9bb0-e96784ca3af1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:55.761565 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-2cb4c145-5138-43f9-9bb0-e96784ca3af1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:55.769487 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2cb4c145-5138-43f9-9bb0-e96784ca3af1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:55.770502 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2cb4c145-5138-43f9-9bb0-e96784ca3af1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:55.772020 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2cb4c145-5138-43f9-9bb0-e96784ca3af1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:55.773252 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2cb4c145-5138-43f9-9bb0-e96784ca3af1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:55.990869 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-84fb9b81-6884-4107-95a2-2fc63a07f93c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:56.003710 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-84fb9b81-6884-4107-95a2-2fc63a07f93c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:56.008801 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-84fb9b81-6884-4107-95a2-2fc63a07f93c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:56.013337 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-84fb9b81-6884-4107-95a2-2fc63a07f93c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1406 microversion: 2.20 time: 0.347426 Nov 23 07:43:56.016759 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 55/112] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:55 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1406 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:43:56.062406 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2cb4c145-5138-43f9-9bb0-e96784ca3af1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:56.092521 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-2cb4c145-5138-43f9-9bb0-e96784ca3af1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.339264 Nov 23 07:43:56.102169 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 58/113] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:55 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:56.433940 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d011bf8b-6edd-499a-aaf5-4b520a0ebc37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:56.434648 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d011bf8b-6edd-499a-aaf5-4b520a0ebc37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:56.441784 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d011bf8b-6edd-499a-aaf5-4b520a0ebc37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:56.442378 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d011bf8b-6edd-499a-aaf5-4b520a0ebc37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:56.443302 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d011bf8b-6edd-499a-aaf5-4b520a0ebc37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:56.443950 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d011bf8b-6edd-499a-aaf5-4b520a0ebc37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:56.596623 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-495b21f9-9e44-40bf-94c8-ea98fec739b2 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:56.598018 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-495b21f9-9e44-40bf-94c8-ea98fec739b2 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:56.604532 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-495b21f9-9e44-40bf-94c8-ea98fec739b2 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:56.605129 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-495b21f9-9e44-40bf-94c8-ea98fec739b2 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:56.605950 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-495b21f9-9e44-40bf-94c8-ea98fec739b2 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:56.606434 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-495b21f9-9e44-40bf-94c8-ea98fec739b2 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:56.636832 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-495b21f9-9e44-40bf-94c8-ea98fec739b2 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Going to try to terminate instance {{(pid=122786) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:43:56.722433 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d011bf8b-6edd-499a-aaf5-4b520a0ebc37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:56.735410 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-495b21f9-9e44-40bf-94c8-ea98fec739b2 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "DELETE /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 204 len: 0 microversion: 2.1 time: 0.142689 Nov 23 07:43:56.736400 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 59/114] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:43:56 2021] DELETE /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 07:43:56.744343 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d011bf8b-6edd-499a-aaf5-4b520a0ebc37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.314083 Nov 23 07:43:56.746046 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 56/115] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:56 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:56.751172 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-83ab8b25-67da-4f98-8b22-d6269a91d536 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:56.752233 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-83ab8b25-67da-4f98-8b22-d6269a91d536 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:56.758905 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-83ab8b25-67da-4f98-8b22-d6269a91d536 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:56.759442 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-83ab8b25-67da-4f98-8b22-d6269a91d536 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:56.760489 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-83ab8b25-67da-4f98-8b22-d6269a91d536 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:56.761448 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-83ab8b25-67da-4f98-8b22-d6269a91d536 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:56.919809 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-83ab8b25-67da-4f98-8b22-d6269a91d536 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:56.928375 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-83ab8b25-67da-4f98-8b22-d6269a91d536 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1553 microversion: 2.1 time: 0.186616 Nov 23 07:43:56.929001 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 60/116] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:56 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:57.033979 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-7f067474-d359-482f-a49f-0cd610a74f31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:57.034579 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-7f067474-d359-482f-a49f-0cd610a74f31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:57.040903 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7f067474-d359-482f-a49f-0cd610a74f31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:57.041348 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7f067474-d359-482f-a49f-0cd610a74f31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:57.042653 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7f067474-d359-482f-a49f-0cd610a74f31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:57.043083 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7f067474-d359-482f-a49f-0cd610a74f31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:57.112788 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-5620aeab-3e48-449d-a6b2-0d990b30b4b7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:57.113542 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-5620aeab-3e48-449d-a6b2-0d990b30b4b7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:57.121224 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5620aeab-3e48-449d-a6b2-0d990b30b4b7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:57.121860 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5620aeab-3e48-449d-a6b2-0d990b30b4b7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:57.122746 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5620aeab-3e48-449d-a6b2-0d990b30b4b7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:57.123275 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5620aeab-3e48-449d-a6b2-0d990b30b4b7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:57.182875 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-7f067474-d359-482f-a49f-0cd610a74f31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:57.191780 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-7f067474-d359-482f-a49f-0cd610a74f31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:57.193572 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-7f067474-d359-482f-a49f-0cd610a74f31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:57.194728 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-7f067474-d359-482f-a49f-0cd610a74f31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1406 microversion: 2.20 time: 0.164548 Nov 23 07:43:57.195289 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 57/117] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:57 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:57.269257 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5620aeab-3e48-449d-a6b2-0d990b30b4b7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:57.277528 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-5620aeab-3e48-449d-a6b2-0d990b30b4b7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.168767 Nov 23 07:43:57.278147 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 61/118] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:57 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:43:57.697421 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-5ed565c9-8096-4f4c-ae32-45fbe84eb858 req-12e05294-c1c1-4594-92c5-ce6701b1bc79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5cba5f7-c9fd-4708-923c-deec6ab27cdd", "name": "network-vif-plugged", "status": "completed", "tag": "98e7ca52-3570-4eee-8b5d-7db714fe981a"}, {"server_uuid": "28c2d383-cc82-4479-b0fe-d92e63ef538d", "name": "network-vif-plugged", "status": "completed", "tag": "12786728-e083-4cb6-b178-3facabd226a9"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:43:57.702279 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:43:57.702279 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:43:57.717244 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-5ed565c9-8096-4f4c-ae32-45fbe84eb858 req-12e05294-c1c1-4594-92c5-ce6701b1bc79 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:57.717694 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-5ed565c9-8096-4f4c-ae32-45fbe84eb858 req-12e05294-c1c1-4594-92c5-ce6701b1bc79 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:57.732539 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-5ed565c9-8096-4f4c-ae32-45fbe84eb858 req-12e05294-c1c1-4594-92c5-ce6701b1bc79 service nova] Creating event network-vif-plugged:98e7ca52-3570-4eee-8b5d-7db714fe981a for instance c5cba5f7-c9fd-4708-923c-deec6ab27cdd on hv-cinder-80403 Nov 23 07:43:57.733208 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-5ed565c9-8096-4f4c-ae32-45fbe84eb858 req-12e05294-c1c1-4594-92c5-ce6701b1bc79 service nova] Creating event network-vif-plugged:12786728-e083-4cb6-b178-3facabd226a9 for instance 28c2d383-cc82-4479-b0fe-d92e63ef538d on hv-cinder-80403 Nov 23 07:43:57.739962 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-5ed565c9-8096-4f4c-ae32-45fbe84eb858 req-12e05294-c1c1-4594-92c5-ce6701b1bc79 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049266 Nov 23 07:43:57.740968 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 58/119] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:43:57 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:43:57.769154 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-5cf3c05c-9de5-4764-a5e5-4babf8ead7f6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:57.775981 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-5cf3c05c-9de5-4764-a5e5-4babf8ead7f6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:57.786072 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5cf3c05c-9de5-4764-a5e5-4babf8ead7f6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:57.786626 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5cf3c05c-9de5-4764-a5e5-4babf8ead7f6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:57.787716 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5cf3c05c-9de5-4764-a5e5-4babf8ead7f6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:57.788453 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5cf3c05c-9de5-4764-a5e5-4babf8ead7f6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:57.945638 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5cf3c05c-9de5-4764-a5e5-4babf8ead7f6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:57.946539 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-e218e6cf-a64f-4b88-8c4c-096d4f8e7452 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:57.947240 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-e218e6cf-a64f-4b88-8c4c-096d4f8e7452 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:57.954156 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e218e6cf-a64f-4b88-8c4c-096d4f8e7452 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:57.954629 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e218e6cf-a64f-4b88-8c4c-096d4f8e7452 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:57.955396 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e218e6cf-a64f-4b88-8c4c-096d4f8e7452 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:57.955825 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e218e6cf-a64f-4b88-8c4c-096d4f8e7452 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:57.956155 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-5cf3c05c-9de5-4764-a5e5-4babf8ead7f6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.196429 Nov 23 07:43:57.956804 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 62/120] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:57 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:58.193147 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-e218e6cf-a64f-4b88-8c4c-096d4f8e7452 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:58.201932 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-e218e6cf-a64f-4b88-8c4c-096d4f8e7452 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1553 microversion: 2.1 time: 0.258887 Nov 23 07:43:58.202597 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 59/121] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:57 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1553 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:43:58.218108 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6bcfdb61-b6c0-4ea7-9410-8e512c6244af tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:58.218711 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6bcfdb61-b6c0-4ea7-9410-8e512c6244af tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:58.225092 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6bcfdb61-b6c0-4ea7-9410-8e512c6244af tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:58.226110 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6bcfdb61-b6c0-4ea7-9410-8e512c6244af tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:58.229769 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6bcfdb61-b6c0-4ea7-9410-8e512c6244af tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:58.230562 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6bcfdb61-b6c0-4ea7-9410-8e512c6244af tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:58.295657 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ba4a58fc-6e7f-4b1e-9079-e96b7224a4bd tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:58.296383 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ba4a58fc-6e7f-4b1e-9079-e96b7224a4bd tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:58.303526 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ba4a58fc-6e7f-4b1e-9079-e96b7224a4bd tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:58.304277 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ba4a58fc-6e7f-4b1e-9079-e96b7224a4bd tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:58.305646 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ba4a58fc-6e7f-4b1e-9079-e96b7224a4bd tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:58.306300 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ba4a58fc-6e7f-4b1e-9079-e96b7224a4bd tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:58.416503 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6bcfdb61-b6c0-4ea7-9410-8e512c6244af tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:58.423097 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6bcfdb61-b6c0-4ea7-9410-8e512c6244af tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:58.424502 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6bcfdb61-b6c0-4ea7-9410-8e512c6244af tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:58.425658 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6bcfdb61-b6c0-4ea7-9410-8e512c6244af tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1597 microversion: 2.20 time: 0.212111 Nov 23 07:43:58.426284 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 63/122] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:43:58 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1597 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:43:58.444110 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-da691c27-e855-4e6b-a49c-374787f939cd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:58.444548 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-da691c27-e855-4e6b-a49c-374787f939cd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:58.451885 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-da691c27-e855-4e6b-a49c-374787f939cd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:58.452321 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-da691c27-e855-4e6b-a49c-374787f939cd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:58.453108 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-da691c27-e855-4e6b-a49c-374787f939cd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:58.453534 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-da691c27-e855-4e6b-a49c-374787f939cd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:58.513587 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ba4a58fc-6e7f-4b1e-9079-e96b7224a4bd tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:58.529105 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ba4a58fc-6e7f-4b1e-9079-e96b7224a4bd tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.237696 Nov 23 07:43:58.534983 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 60/123] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:58 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:43:58.565052 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-da691c27-e855-4e6b-a49c-374787f939cd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.124642 Nov 23 07:43:58.565781 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 64/124] 10.222.0.48 () {60 vars in 1315 bytes} [Tue Nov 23 07:43:58 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:43:58.975679 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-dc256bac-025b-4466-a1f6-80219f165e37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:58.977809 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-dc256bac-025b-4466-a1f6-80219f165e37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:58.988098 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-dc256bac-025b-4466-a1f6-80219f165e37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:58.989540 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-dc256bac-025b-4466-a1f6-80219f165e37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:58.996839 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-dc256bac-025b-4466-a1f6-80219f165e37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:58.997490 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-dc256bac-025b-4466-a1f6-80219f165e37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:59.220856 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4b460633-1905-46cc-b3b9-14c5f0df0838 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:59.221877 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4b460633-1905-46cc-b3b9-14c5f0df0838 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:59.230850 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4b460633-1905-46cc-b3b9-14c5f0df0838 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:59.231473 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4b460633-1905-46cc-b3b9-14c5f0df0838 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:59.233331 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4b460633-1905-46cc-b3b9-14c5f0df0838 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:59.233939 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4b460633-1905-46cc-b3b9-14c5f0df0838 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:59.283919 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-dc256bac-025b-4466-a1f6-80219f165e37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:59.298513 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-dc256bac-025b-4466-a1f6-80219f165e37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1363 microversion: 2.1 time: 0.329004 Nov 23 07:43:59.303224 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 61/125] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:58 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1363 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:59.414343 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-4b460633-1905-46cc-b3b9-14c5f0df0838 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:43:59.437235 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4b460633-1905-46cc-b3b9-14c5f0df0838 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1553 microversion: 2.1 time: 0.221211 Nov 23 07:43:59.451580 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 65/126] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:59 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1553 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:43:59.546975 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-607aa7b2-9944-4c59-b33a-480dcbd5b677 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:43:59.547724 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-607aa7b2-9944-4c59-b33a-480dcbd5b677 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:43:59.554538 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-607aa7b2-9944-4c59-b33a-480dcbd5b677 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:59.555120 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-607aa7b2-9944-4c59-b33a-480dcbd5b677 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:43:59.556146 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-607aa7b2-9944-4c59-b33a-480dcbd5b677 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:43:59.556694 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-607aa7b2-9944-4c59-b33a-480dcbd5b677 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:00.040227 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-607aa7b2-9944-4c59-b33a-480dcbd5b677 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:00.072214 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-607aa7b2-9944-4c59-b33a-480dcbd5b677 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.528988 Nov 23 07:44:00.083014 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 62/127] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:43:59 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:00.323197 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-3e63447a-a9e3-41c3-ba3a-02be468f2b8c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:00.323816 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-3e63447a-a9e3-41c3-ba3a-02be468f2b8c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:00.329773 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3e63447a-a9e3-41c3-ba3a-02be468f2b8c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:00.330513 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3e63447a-a9e3-41c3-ba3a-02be468f2b8c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:00.331257 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3e63447a-a9e3-41c3-ba3a-02be468f2b8c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:00.331885 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3e63447a-a9e3-41c3-ba3a-02be468f2b8c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:00.466329 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-9012507c-de29-4667-b1fb-26f87f9cdb2f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:00.469162 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-9012507c-de29-4667-b1fb-26f87f9cdb2f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:00.476584 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9012507c-de29-4667-b1fb-26f87f9cdb2f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:00.477641 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9012507c-de29-4667-b1fb-26f87f9cdb2f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:00.478590 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9012507c-de29-4667-b1fb-26f87f9cdb2f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:00.479175 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9012507c-de29-4667-b1fb-26f87f9cdb2f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:00.558050 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-3e63447a-a9e3-41c3-ba3a-02be468f2b8c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:00.571019 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-3e63447a-a9e3-41c3-ba3a-02be468f2b8c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1549 microversion: 2.1 time: 0.251477 Nov 23 07:44:00.574383 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 66/128] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:00 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1549 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:00.579821 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-fab0d287-4f3c-411f-aa40-8c2e8eb6d352 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:00.581873 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-fab0d287-4f3c-411f-aa40-8c2e8eb6d352 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:00.589968 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fab0d287-4f3c-411f-aa40-8c2e8eb6d352 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:00.590747 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fab0d287-4f3c-411f-aa40-8c2e8eb6d352 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:00.592212 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fab0d287-4f3c-411f-aa40-8c2e8eb6d352 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:00.593846 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fab0d287-4f3c-411f-aa40-8c2e8eb6d352 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:00.723335 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-fab0d287-4f3c-411f-aa40-8c2e8eb6d352 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 14 microversion: 2.20 time: 0.147261 Nov 23 07:44:00.728148 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 67/129] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:00 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:00.736739 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-d5c225d2-304b-47f3-8640-b28b39f3b3b6 req-898aa155-8ceb-4a44-86eb-d705b89eb898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb841a35-6344-43a0-85d2-6de8116759b1", "tag": "8b4fce4b-5f2b-4eea-8335-5d57ac70511e"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:00.740238 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:44:00.740238 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:44:00.749876 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-d5c225d2-304b-47f3-8640-b28b39f3b3b6 req-898aa155-8ceb-4a44-86eb-d705b89eb898 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:00.750624 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-d5c225d2-304b-47f3-8640-b28b39f3b3b6 req-898aa155-8ceb-4a44-86eb-d705b89eb898 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:00.769767 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-d5c225d2-304b-47f3-8640-b28b39f3b3b6 req-898aa155-8ceb-4a44-86eb-d705b89eb898 service nova] Creating event network-changed:8b4fce4b-5f2b-4eea-8335-5d57ac70511e for instance bb841a35-6344-43a0-85d2-6de8116759b1 on hv-cinder-80403 Nov 23 07:44:00.777291 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-d5c225d2-304b-47f3-8640-b28b39f3b3b6 req-898aa155-8ceb-4a44-86eb-d705b89eb898 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045965 Nov 23 07:44:00.778190 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 68/130] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:44:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:44:00.786037 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-f1cc3530-1a76-440a-95e8-885e142ac27e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:00.786746 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f1cc3530-1a76-440a-95e8-885e142ac27e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:00.798461 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f1cc3530-1a76-440a-95e8-885e142ac27e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:00.798917 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f1cc3530-1a76-440a-95e8-885e142ac27e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:00.801116 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f1cc3530-1a76-440a-95e8-885e142ac27e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:00.802175 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f1cc3530-1a76-440a-95e8-885e142ac27e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:00.874464 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-9012507c-de29-4667-b1fb-26f87f9cdb2f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:00.886472 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-9012507c-de29-4667-b1fb-26f87f9cdb2f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1553 microversion: 2.1 time: 0.430561 Nov 23 07:44:00.887247 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 63/131] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:00 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1553 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:00.911857 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-f1cc3530-1a76-440a-95e8-885e142ac27e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131945 Nov 23 07:44:00.912701 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 69/132] 10.222.0.48 () {58 vars in 1274 bytes} [Tue Nov 23 07:44:00 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:44:01.091558 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d6f96ced-5578-4b95-bc86-e7bf9dbcffbb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:01.092558 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d6f96ced-5578-4b95-bc86-e7bf9dbcffbb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:01.107188 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d6f96ced-5578-4b95-bc86-e7bf9dbcffbb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:01.107636 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d6f96ced-5578-4b95-bc86-e7bf9dbcffbb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:01.109136 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d6f96ced-5578-4b95-bc86-e7bf9dbcffbb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:01.110112 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d6f96ced-5578-4b95-bc86-e7bf9dbcffbb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:01.543021 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d6f96ced-5578-4b95-bc86-e7bf9dbcffbb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:01.558025 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d6f96ced-5578-4b95-bc86-e7bf9dbcffbb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.465847 Nov 23 07:44:01.559140 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 64/133] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:01 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:01.736364 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-141d715d-5f9c-456a-8090-6fac8f8f99ac tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:01.738004 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-141d715d-5f9c-456a-8090-6fac8f8f99ac tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:01.747013 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-141d715d-5f9c-456a-8090-6fac8f8f99ac tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:01.747783 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-141d715d-5f9c-456a-8090-6fac8f8f99ac tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:01.748784 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-141d715d-5f9c-456a-8090-6fac8f8f99ac tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:01.749693 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-141d715d-5f9c-456a-8090-6fac8f8f99ac tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:01.833969 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-141d715d-5f9c-456a-8090-6fac8f8f99ac tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 14 microversion: 2.20 time: 0.101525 Nov 23 07:44:01.838416 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 70/134] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:01 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:01.905655 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-326be206-5b6f-48b1-ba54-bd519880cf1f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:01.906522 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-326be206-5b6f-48b1-ba54-bd519880cf1f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:01.914876 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-326be206-5b6f-48b1-ba54-bd519880cf1f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:01.915691 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-326be206-5b6f-48b1-ba54-bd519880cf1f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:01.916709 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-326be206-5b6f-48b1-ba54-bd519880cf1f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:01.918674 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-326be206-5b6f-48b1-ba54-bd519880cf1f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:01.976242 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-326be206-5b6f-48b1-ba54-bd519880cf1f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:01.987687 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-326be206-5b6f-48b1-ba54-bd519880cf1f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:01.988199 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.objects.instance [None req-326be206-5b6f-48b1-ba54-bd519880cf1f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lazy-loading 'fault' on Instance uuid be4189be-d8dd-4c98-8200-662d44bcb4a4 {{(pid=122785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:44:02.111258 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-326be206-5b6f-48b1-ba54-bd519880cf1f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774f2e9c6be478184c03e319c96eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02de9f94b74169860663f89342f9d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:02.121352 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-326be206-5b6f-48b1-ba54-bd519880cf1f tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 200 len: 1351 microversion: 2.1 time: 0.220274 Nov 23 07:44:02.122897 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 65/135] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:01 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 1351 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:44:02.576745 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-989277c0-423b-4d24-b826-bbf4e1d54740 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:02.577885 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-989277c0-423b-4d24-b826-bbf4e1d54740 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:02.584980 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-989277c0-423b-4d24-b826-bbf4e1d54740 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:02.585316 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-989277c0-423b-4d24-b826-bbf4e1d54740 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:02.586746 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-989277c0-423b-4d24-b826-bbf4e1d54740 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:02.587592 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-989277c0-423b-4d24-b826-bbf4e1d54740 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:02.793852 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-3a0b0297-1c26-4e2a-a66a-86f304630467 req-d2f2a925-0c8a-44f1-b551-269d4b88e132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be4189be-d8dd-4c98-8200-662d44bcb4a4", "name": "network-vif-deleted", "tag": "54bccf3f-426b-4efd-8ab3-2d36cb64b211"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:02.795451 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:44:02.795451 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:44:02.803751 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-3a0b0297-1c26-4e2a-a66a-86f304630467 req-d2f2a925-0c8a-44f1-b551-269d4b88e132 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:02.804777 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-3a0b0297-1c26-4e2a-a66a-86f304630467 req-d2f2a925-0c8a-44f1-b551-269d4b88e132 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:02.822830 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-3a0b0297-1c26-4e2a-a66a-86f304630467 req-d2f2a925-0c8a-44f1-b551-269d4b88e132 service nova] Creating event network-vif-deleted:54bccf3f-426b-4efd-8ab3-2d36cb64b211 for instance be4189be-d8dd-4c98-8200-662d44bcb4a4 on hv-cinder-80403 Nov 23 07:44:02.844011 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-3a0b0297-1c26-4e2a-a66a-86f304630467 req-d2f2a925-0c8a-44f1-b551-269d4b88e132 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054688 Nov 23 07:44:02.849295 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 66/136] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:44:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:44:02.854034 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-989277c0-423b-4d24-b826-bbf4e1d54740 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:02.860413 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-db141ade-b43d-473a-b883-08f94d56de02 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:02.861797 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-db141ade-b43d-473a-b883-08f94d56de02 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:02.864158 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-989277c0-423b-4d24-b826-bbf4e1d54740 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.292292 Nov 23 07:44:02.865034 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 71/137] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:02 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:02.870845 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-770af07b-4d82-453f-8101-83028fb405a4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:02.872303 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-770af07b-4d82-453f-8101-83028fb405a4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:02.880019 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-db141ade-b43d-473a-b883-08f94d56de02 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:02.880778 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-db141ade-b43d-473a-b883-08f94d56de02 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:02.881871 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-db141ade-b43d-473a-b883-08f94d56de02 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:02.882559 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-db141ade-b43d-473a-b883-08f94d56de02 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:02.887651 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-770af07b-4d82-453f-8101-83028fb405a4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:02.891871 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-770af07b-4d82-453f-8101-83028fb405a4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:02.893385 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-770af07b-4d82-453f-8101-83028fb405a4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:02.893979 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-770af07b-4d82-453f-8101-83028fb405a4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:02.958023 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-db141ade-b43d-473a-b883-08f94d56de02 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 14 microversion: 2.1 time: 0.106701 Nov 23 07:44:02.958658 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 67/138] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:02 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:44:02.964252 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-ee74ac22-b14d-4341-a290-96b9e235fd69 req-f516d5c2-78e6-47f7-b937-83cd9425deb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c2d383-cc82-4479-b0fe-d92e63ef538d", "tag": "12786728-e083-4cb6-b178-3facabd226a9"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:02.966340 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:44:02.966340 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:44:02.967462 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-770af07b-4d82-453f-8101-83028fb405a4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 14 microversion: 2.20 time: 0.100551 Nov 23 07:44:02.970769 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 72/139] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:02 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:02.974301 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-ee74ac22-b14d-4341-a290-96b9e235fd69 req-f516d5c2-78e6-47f7-b937-83cd9425deb5 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:02.974743 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-ee74ac22-b14d-4341-a290-96b9e235fd69 req-f516d5c2-78e6-47f7-b937-83cd9425deb5 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:02.990268 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-ee74ac22-b14d-4341-a290-96b9e235fd69 req-f516d5c2-78e6-47f7-b937-83cd9425deb5 service nova] Creating event network-changed:12786728-e083-4cb6-b178-3facabd226a9 for instance 28c2d383-cc82-4479-b0fe-d92e63ef538d on hv-cinder-80403 Nov 23 07:44:02.996070 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-ee74ac22-b14d-4341-a290-96b9e235fd69 req-f516d5c2-78e6-47f7-b937-83cd9425deb5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035681 Nov 23 07:44:02.996756 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 68/140] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:44:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:44:03.179407 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-33c81f08-4e68-478c-9555-a0ec9a0db3a0 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:03.181033 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-33c81f08-4e68-478c-9555-a0ec9a0db3a0 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:03.196717 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-33c81f08-4e68-478c-9555-a0ec9a0db3a0 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:03.199249 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-33c81f08-4e68-478c-9555-a0ec9a0db3a0 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:03.200997 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-33c81f08-4e68-478c-9555-a0ec9a0db3a0 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:03.202024 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-33c81f08-4e68-478c-9555-a0ec9a0db3a0 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:03.229371 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-33c81f08-4e68-478c-9555-a0ec9a0db3a0 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] HTTP exception thrown: Instance be4189be-d8dd-4c98-8200-662d44bcb4a4 could not be found. Nov 23 07:44:03.230159 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-33c81f08-4e68-478c-9555-a0ec9a0db3a0 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Returning 404 to user: Instance be4189be-d8dd-4c98-8200-662d44bcb4a4 could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:44:03.231007 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-33c81f08-4e68-478c-9555-a0ec9a0db3a0 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 404 len: 111 microversion: 2.1 time: 0.083949 Nov 23 07:44:03.231565 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 73/141] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:03 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:44:03.347400 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-37966389-9253-46fe-841e-8b7a9dbb5f24 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:03.348495 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-37966389-9253-46fe-841e-8b7a9dbb5f24 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:03.354755 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-37966389-9253-46fe-841e-8b7a9dbb5f24 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:03.355762 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-37966389-9253-46fe-841e-8b7a9dbb5f24 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:03.356959 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-37966389-9253-46fe-841e-8b7a9dbb5f24 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:03.357663 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-37966389-9253-46fe-841e-8b7a9dbb5f24 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:03.377473 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-37966389-9253-46fe-841e-8b7a9dbb5f24 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] HTTP exception thrown: Instance be4189be-d8dd-4c98-8200-662d44bcb4a4 could not be found. Nov 23 07:44:03.378657 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-37966389-9253-46fe-841e-8b7a9dbb5f24 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Returning 404 to user: Instance be4189be-d8dd-4c98-8200-662d44bcb4a4 could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:44:03.380490 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-37966389-9253-46fe-841e-8b7a9dbb5f24 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037665 Nov 23 07:44:03.383329 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 69/142] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:44:03 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:44:03.884330 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d8c0ce6d-146a-46b7-add9-c91c2e5e4776 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:03.884966 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d8c0ce6d-146a-46b7-add9-c91c2e5e4776 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:03.892860 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d8c0ce6d-146a-46b7-add9-c91c2e5e4776 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:03.893318 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d8c0ce6d-146a-46b7-add9-c91c2e5e4776 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:03.894544 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d8c0ce6d-146a-46b7-add9-c91c2e5e4776 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:03.894973 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d8c0ce6d-146a-46b7-add9-c91c2e5e4776 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:03.969783 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ce2f5ec2-1b57-4777-bea9-9d8bcade39de tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:03.971275 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ce2f5ec2-1b57-4777-bea9-9d8bcade39de tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:03.979338 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ce2f5ec2-1b57-4777-bea9-9d8bcade39de tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:03.981112 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ce2f5ec2-1b57-4777-bea9-9d8bcade39de tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:03.984995 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ce2f5ec2-1b57-4777-bea9-9d8bcade39de tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:03.986500 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ce2f5ec2-1b57-4777-bea9-9d8bcade39de tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:04.067361 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ce2f5ec2-1b57-4777-bea9-9d8bcade39de tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 14 microversion: 2.1 time: 0.101242 Nov 23 07:44:04.067894 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 70/143] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:03 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:44:04.078680 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-13b07cae-6137-441c-8f3a-7af8962317ab tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:04.079936 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-13b07cae-6137-441c-8f3a-7af8962317ab tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:04.083256 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d8c0ce6d-146a-46b7-add9-c91c2e5e4776 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:04.089721 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13b07cae-6137-441c-8f3a-7af8962317ab tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:04.090344 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13b07cae-6137-441c-8f3a-7af8962317ab tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:04.091322 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13b07cae-6137-441c-8f3a-7af8962317ab tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:04.091765 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13b07cae-6137-441c-8f3a-7af8962317ab tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:04.091872 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d8c0ce6d-146a-46b7-add9-c91c2e5e4776 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.211212 Nov 23 07:44:04.092426 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 74/144] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:03 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:04.167301 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-13b07cae-6137-441c-8f3a-7af8962317ab tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 14 microversion: 2.20 time: 0.094823 Nov 23 07:44:04.167964 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 71/145] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:04 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:04.629803 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a604ed6a-a1c4-474f-8dab-335ddd742974 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:04.630323 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a604ed6a-a1c4-474f-8dab-335ddd742974 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:04.636911 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a604ed6a-a1c4-474f-8dab-335ddd742974 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:04.637263 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a604ed6a-a1c4-474f-8dab-335ddd742974 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:04.638270 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a604ed6a-a1c4-474f-8dab-335ddd742974 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:04.638701 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a604ed6a-a1c4-474f-8dab-335ddd742974 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:04.654472 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-a604ed6a-a1c4-474f-8dab-335ddd742974 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] HTTP exception thrown: Instance be4189be-d8dd-4c98-8200-662d44bcb4a4 could not be found. Nov 23 07:44:04.655067 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a604ed6a-a1c4-474f-8dab-335ddd742974 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Returning 404 to user: Instance be4189be-d8dd-4c98-8200-662d44bcb4a4 could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:44:04.655946 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a604ed6a-a1c4-474f-8dab-335ddd742974 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "DELETE /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 404 len: 111 microversion: 2.1 time: 0.031290 Nov 23 07:44:04.659338 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 75/146] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:44:04 2021] DELETE /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:44:04.666270 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-926c72b8-b9ed-413a-a97c-607779bbe089 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:04.670597 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-926c72b8-b9ed-413a-a97c-607779bbe089 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] [instance: be4189be-d8dd-4c98-8200-662d44bcb4a4] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:04.679552 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-926c72b8-b9ed-413a-a97c-607779bbe089 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:04.680013 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-926c72b8-b9ed-413a-a97c-607779bbe089 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:04.680794 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-926c72b8-b9ed-413a-a97c-607779bbe089 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:04.681389 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-926c72b8-b9ed-413a-a97c-607779bbe089 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:04.711839 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-926c72b8-b9ed-413a-a97c-607779bbe089 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] HTTP exception thrown: Instance be4189be-d8dd-4c98-8200-662d44bcb4a4 could not be found. Nov 23 07:44:04.722855 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-926c72b8-b9ed-413a-a97c-607779bbe089 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] Returning 404 to user: Instance be4189be-d8dd-4c98-8200-662d44bcb4a4 could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:44:04.726839 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-926c72b8-b9ed-413a-a97c-607779bbe089 tempest-DeleteServersTestJSON-630107864 tempest-DeleteServersTestJSON-630107864-project] 10.222.0.48 "GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4" status: 404 len: 111 microversion: 2.1 time: 0.063418 Nov 23 07:44:04.727717 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 72/147] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:04 2021] GET /compute/v2.1/servers/be4189be-d8dd-4c98-8200-662d44bcb4a4 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:44:05.079396 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-614b27ec-6fe4-4b7c-9744-bb5258d7e9f7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:05.084719 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-614b27ec-6fe4-4b7c-9744-bb5258d7e9f7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:05.092523 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-614b27ec-6fe4-4b7c-9744-bb5258d7e9f7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:05.094545 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-614b27ec-6fe4-4b7c-9744-bb5258d7e9f7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:05.094912 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-614b27ec-6fe4-4b7c-9744-bb5258d7e9f7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:05.095352 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-614b27ec-6fe4-4b7c-9744-bb5258d7e9f7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:05.115063 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-9ffe9e98-abeb-43f0-866d-13021d901692 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:05.115939 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-9ffe9e98-abeb-43f0-866d-13021d901692 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:05.123914 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9ffe9e98-abeb-43f0-866d-13021d901692 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:05.124930 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9ffe9e98-abeb-43f0-866d-13021d901692 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:05.126838 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9ffe9e98-abeb-43f0-866d-13021d901692 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:05.130678 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9ffe9e98-abeb-43f0-866d-13021d901692 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:05.169435 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-614b27ec-6fe4-4b7c-9744-bb5258d7e9f7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 14 microversion: 2.1 time: 0.094294 Nov 23 07:44:05.170932 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 76/148] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:05 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:44:05.180457 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-42bf1dbe-81d1-4738-bb63-11f8378d7c80 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:05.181803 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-42bf1dbe-81d1-4738-bb63-11f8378d7c80 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:05.191895 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-42bf1dbe-81d1-4738-bb63-11f8378d7c80 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:05.192585 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-42bf1dbe-81d1-4738-bb63-11f8378d7c80 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:05.193642 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-42bf1dbe-81d1-4738-bb63-11f8378d7c80 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:05.194327 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-42bf1dbe-81d1-4738-bb63-11f8378d7c80 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:05.265758 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-42bf1dbe-81d1-4738-bb63-11f8378d7c80 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 14 microversion: 2.20 time: 0.089379 Nov 23 07:44:05.267571 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 77/149] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:05 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:44:05.593915 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-9ffe9e98-abeb-43f0-866d-13021d901692 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:05.603071 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-9ffe9e98-abeb-43f0-866d-13021d901692 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.491805 Nov 23 07:44:05.603700 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 73/150] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:05 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:44:06.180387 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-21682bf6-573f-4590-a1d9-fdf76eb636f3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:06.181437 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-21682bf6-573f-4590-a1d9-fdf76eb636f3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:06.190912 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-21682bf6-573f-4590-a1d9-fdf76eb636f3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:06.191526 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-21682bf6-573f-4590-a1d9-fdf76eb636f3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:06.192535 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-21682bf6-573f-4590-a1d9-fdf76eb636f3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:06.193130 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-21682bf6-573f-4590-a1d9-fdf76eb636f3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:06.267165 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-21682bf6-573f-4590-a1d9-fdf76eb636f3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 14 microversion: 2.1 time: 0.090588 Nov 23 07:44:06.267940 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 78/151] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:06 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:44:06.278230 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-55bc791d-4e8e-4a68-bce7-4f861120da28 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:06.279439 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-55bc791d-4e8e-4a68-bce7-4f861120da28 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:06.286831 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-55bc791d-4e8e-4a68-bce7-4f861120da28 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:06.287622 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-55bc791d-4e8e-4a68-bce7-4f861120da28 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:06.288681 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-55bc791d-4e8e-4a68-bce7-4f861120da28 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:06.289591 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-55bc791d-4e8e-4a68-bce7-4f861120da28 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:06.374218 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-55bc791d-4e8e-4a68-bce7-4f861120da28 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 14 microversion: 2.20 time: 0.098195 Nov 23 07:44:06.375381 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 74/152] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:06 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:06.621921 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-f26bca26-f66d-41d1-beef-d19c2cf01773 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:06.622843 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f26bca26-f66d-41d1-beef-d19c2cf01773 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:06.629942 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f26bca26-f66d-41d1-beef-d19c2cf01773 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:06.630575 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f26bca26-f66d-41d1-beef-d19c2cf01773 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:06.631641 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f26bca26-f66d-41d1-beef-d19c2cf01773 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:06.632225 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f26bca26-f66d-41d1-beef-d19c2cf01773 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:06.790425 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-f26bca26-f66d-41d1-beef-d19c2cf01773 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:06.802599 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-f26bca26-f66d-41d1-beef-d19c2cf01773 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.185677 Nov 23 07:44:06.803245 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 79/153] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:06 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:07.279029 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-80b032ed-0fb4-4f15-9d12-8a800034ae6b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:07.280128 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-80b032ed-0fb4-4f15-9d12-8a800034ae6b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:07.287386 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-80b032ed-0fb4-4f15-9d12-8a800034ae6b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:07.288025 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-80b032ed-0fb4-4f15-9d12-8a800034ae6b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:07.288815 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-80b032ed-0fb4-4f15-9d12-8a800034ae6b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:07.289672 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-80b032ed-0fb4-4f15-9d12-8a800034ae6b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:07.361203 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-80b032ed-0fb4-4f15-9d12-8a800034ae6b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 14 microversion: 2.1 time: 0.086494 Nov 23 07:44:07.361855 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 75/154] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:07 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:44:07.387103 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-fd250de1-a17e-4a5f-b10e-f41dbecf4602 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:07.388045 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-fd250de1-a17e-4a5f-b10e-f41dbecf4602 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:07.395010 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fd250de1-a17e-4a5f-b10e-f41dbecf4602 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:07.395450 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fd250de1-a17e-4a5f-b10e-f41dbecf4602 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:07.396240 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fd250de1-a17e-4a5f-b10e-f41dbecf4602 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:07.396671 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fd250de1-a17e-4a5f-b10e-f41dbecf4602 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:07.464204 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-fd250de1-a17e-4a5f-b10e-f41dbecf4602 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 14 microversion: 2.20 time: 0.081017 Nov 23 07:44:07.467828 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 80/155] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:07 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:07.825242 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-fcfb2ca7-ef9a-4390-aa08-64be1c3018c8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:07.826765 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-fcfb2ca7-ef9a-4390-aa08-64be1c3018c8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:07.844596 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fcfb2ca7-ef9a-4390-aa08-64be1c3018c8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:07.845170 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fcfb2ca7-ef9a-4390-aa08-64be1c3018c8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:07.846069 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fcfb2ca7-ef9a-4390-aa08-64be1c3018c8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:07.846724 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fcfb2ca7-ef9a-4390-aa08-64be1c3018c8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:07.997762 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-fcfb2ca7-ef9a-4390-aa08-64be1c3018c8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:08.008296 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-fcfb2ca7-ef9a-4390-aa08-64be1c3018c8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.187500 Nov 23 07:44:08.014408 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 76/156] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:07 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:08.372484 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-38e2301e-f82a-4d86-bf85-39f47a957bb9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:08.373537 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-38e2301e-f82a-4d86-bf85-39f47a957bb9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:08.381469 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-38e2301e-f82a-4d86-bf85-39f47a957bb9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:08.381946 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-38e2301e-f82a-4d86-bf85-39f47a957bb9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:08.382820 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-38e2301e-f82a-4d86-bf85-39f47a957bb9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:08.383558 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-38e2301e-f82a-4d86-bf85-39f47a957bb9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:08.459174 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-38e2301e-f82a-4d86-bf85-39f47a957bb9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 14 microversion: 2.1 time: 0.090719 Nov 23 07:44:08.460491 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 81/157] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:08 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:44:08.476110 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-29615dbf-4c46-4959-8d5b-e687a0390b17 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:08.477050 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-29615dbf-4c46-4959-8d5b-e687a0390b17 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:08.483588 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-29615dbf-4c46-4959-8d5b-e687a0390b17 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:08.484041 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-29615dbf-4c46-4959-8d5b-e687a0390b17 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:08.484840 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-29615dbf-4c46-4959-8d5b-e687a0390b17 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:08.485355 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-29615dbf-4c46-4959-8d5b-e687a0390b17 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:08.559442 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-29615dbf-4c46-4959-8d5b-e687a0390b17 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 14 microversion: 2.20 time: 0.087464 Nov 23 07:44:08.560344 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 77/158] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:08 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:09.027413 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-3680c271-f510-414d-8157-6795d8dc4981 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:09.028149 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-3680c271-f510-414d-8157-6795d8dc4981 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:09.035220 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3680c271-f510-414d-8157-6795d8dc4981 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:09.035674 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3680c271-f510-414d-8157-6795d8dc4981 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:09.036470 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3680c271-f510-414d-8157-6795d8dc4981 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:09.036910 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3680c271-f510-414d-8157-6795d8dc4981 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:09.185121 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-3680c271-f510-414d-8157-6795d8dc4981 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:09.192492 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-3680c271-f510-414d-8157-6795d8dc4981 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.169205 Nov 23 07:44:09.193064 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 82/159] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:09 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:09.472288 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-273a05cf-a798-4562-ae3b-b926893c9cbd tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:09.473289 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-273a05cf-a798-4562-ae3b-b926893c9cbd tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:09.481162 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-273a05cf-a798-4562-ae3b-b926893c9cbd tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:09.481838 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-273a05cf-a798-4562-ae3b-b926893c9cbd tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:09.482571 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-273a05cf-a798-4562-ae3b-b926893c9cbd tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:09.483016 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-273a05cf-a798-4562-ae3b-b926893c9cbd tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:09.570133 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d2f96e27-4a69-421c-9b21-aaba93d05c1e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:09.571088 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d2f96e27-4a69-421c-9b21-aaba93d05c1e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:09.572520 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-273a05cf-a798-4562-ae3b-b926893c9cbd tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 14 microversion: 2.1 time: 0.104045 Nov 23 07:44:09.573549 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 78/160] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:09 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:44:09.581012 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d2f96e27-4a69-421c-9b21-aaba93d05c1e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:09.581465 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d2f96e27-4a69-421c-9b21-aaba93d05c1e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:09.582309 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d2f96e27-4a69-421c-9b21-aaba93d05c1e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:09.582784 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d2f96e27-4a69-421c-9b21-aaba93d05c1e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:09.653092 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d2f96e27-4a69-421c-9b21-aaba93d05c1e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 14 microversion: 2.20 time: 0.086522 Nov 23 07:44:09.653913 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 83/161] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:09 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:10.210667 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-2e44e499-431b-43cb-bf28-ab88422e131d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:10.211376 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-2e44e499-431b-43cb-bf28-ab88422e131d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:10.219021 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2e44e499-431b-43cb-bf28-ab88422e131d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:10.219501 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2e44e499-431b-43cb-bf28-ab88422e131d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:10.220295 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2e44e499-431b-43cb-bf28-ab88422e131d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:10.220767 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2e44e499-431b-43cb-bf28-ab88422e131d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:10.414034 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-2e44e499-431b-43cb-bf28-ab88422e131d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:10.424442 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-2e44e499-431b-43cb-bf28-ab88422e131d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.217738 Nov 23 07:44:10.425030 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 79/162] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:10 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:10.584828 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8c45d9d3-d244-4f22-be76-f379541a1e1c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:10.585993 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8c45d9d3-d244-4f22-be76-f379541a1e1c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:10.593984 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8c45d9d3-d244-4f22-be76-f379541a1e1c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:10.594514 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8c45d9d3-d244-4f22-be76-f379541a1e1c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:10.595366 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8c45d9d3-d244-4f22-be76-f379541a1e1c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:10.595893 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8c45d9d3-d244-4f22-be76-f379541a1e1c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:10.664983 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ec47d516-c5d4-4a40-a8f9-a6a703e3acef tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:10.666798 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ec47d516-c5d4-4a40-a8f9-a6a703e3acef tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:10.669184 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-8c45d9d3-d244-4f22-be76-f379541a1e1c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 14 microversion: 2.1 time: 0.088282 Nov 23 07:44:10.672690 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 84/163] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:10 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:44:10.674095 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ec47d516-c5d4-4a40-a8f9-a6a703e3acef tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:10.674540 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ec47d516-c5d4-4a40-a8f9-a6a703e3acef tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:10.675365 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ec47d516-c5d4-4a40-a8f9-a6a703e3acef tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:10.675853 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ec47d516-c5d4-4a40-a8f9-a6a703e3acef tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:10.756529 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ec47d516-c5d4-4a40-a8f9-a6a703e3acef tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 14 microversion: 2.20 time: 0.095974 Nov 23 07:44:10.757161 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 80/164] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:10 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:44:11.450838 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1a6a1918-0829-48e9-b54e-e7770e294426 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:11.452474 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1a6a1918-0829-48e9-b54e-e7770e294426 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:11.463039 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1a6a1918-0829-48e9-b54e-e7770e294426 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:11.463538 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1a6a1918-0829-48e9-b54e-e7770e294426 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:11.468180 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1a6a1918-0829-48e9-b54e-e7770e294426 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:11.469138 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1a6a1918-0829-48e9-b54e-e7770e294426 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:11.680243 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1a6a1918-0829-48e9-b54e-e7770e294426 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:11.681174 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-e5789afd-2bcf-4340-800a-cbe1d8546501 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:11.682130 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-e5789afd-2bcf-4340-800a-cbe1d8546501 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:11.688176 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1a6a1918-0829-48e9-b54e-e7770e294426 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.246249 Nov 23 07:44:11.689992 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e5789afd-2bcf-4340-800a-cbe1d8546501 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:11.690677 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e5789afd-2bcf-4340-800a-cbe1d8546501 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:11.691727 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e5789afd-2bcf-4340-800a-cbe1d8546501 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:11.692409 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e5789afd-2bcf-4340-800a-cbe1d8546501 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:11.698784 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 85/165] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:11 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:11.767003 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-e5789afd-2bcf-4340-800a-cbe1d8546501 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 14 microversion: 2.1 time: 0.089544 Nov 23 07:44:11.768750 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 81/166] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:11 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:44:11.773420 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-02942441-3997-472d-994c-1675cf56ced9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:11.774753 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-02942441-3997-472d-994c-1675cf56ced9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:11.784842 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-02942441-3997-472d-994c-1675cf56ced9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:11.785609 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-02942441-3997-472d-994c-1675cf56ced9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:11.786646 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-02942441-3997-472d-994c-1675cf56ced9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:11.787050 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-02942441-3997-472d-994c-1675cf56ced9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:11.858460 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-02942441-3997-472d-994c-1675cf56ced9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 14 microversion: 2.20 time: 0.090635 Nov 23 07:44:11.859642 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 86/167] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:11 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:44:12.706625 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-19ea326b-116d-4737-936d-06822ce82e77 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:12.707328 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-19ea326b-116d-4737-936d-06822ce82e77 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:12.714602 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-19ea326b-116d-4737-936d-06822ce82e77 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:12.715430 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-19ea326b-116d-4737-936d-06822ce82e77 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:12.716564 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-19ea326b-116d-4737-936d-06822ce82e77 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:12.717113 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-19ea326b-116d-4737-936d-06822ce82e77 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:12.783187 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-97844786-3c19-44b5-8494-ed1a20ee63de tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:12.784847 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-97844786-3c19-44b5-8494-ed1a20ee63de tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:12.794149 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-97844786-3c19-44b5-8494-ed1a20ee63de tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:12.794985 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-97844786-3c19-44b5-8494-ed1a20ee63de tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:12.795952 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-97844786-3c19-44b5-8494-ed1a20ee63de tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:12.796386 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-97844786-3c19-44b5-8494-ed1a20ee63de tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:12.880683 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-97844786-3c19-44b5-8494-ed1a20ee63de tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 14 microversion: 2.1 time: 0.104318 Nov 23 07:44:12.881326 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 87/168] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:12 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:44:12.892066 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-aa54ec96-8b10-46fc-911c-9dd02f9841e1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:12.893082 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-aa54ec96-8b10-46fc-911c-9dd02f9841e1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:12.901644 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aa54ec96-8b10-46fc-911c-9dd02f9841e1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:12.902278 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aa54ec96-8b10-46fc-911c-9dd02f9841e1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:12.903081 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aa54ec96-8b10-46fc-911c-9dd02f9841e1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:12.903518 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aa54ec96-8b10-46fc-911c-9dd02f9841e1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:12.973583 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-19ea326b-116d-4737-936d-06822ce82e77 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:12.975486 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-aa54ec96-8b10-46fc-911c-9dd02f9841e1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 14 microversion: 2.20 time: 0.089327 Nov 23 07:44:12.976358 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 88/169] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:12 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:12.984906 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-19ea326b-116d-4737-936d-06822ce82e77 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.282045 Nov 23 07:44:12.985672 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 82/170] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:12 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:13.891905 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-99d50b0f-8b7b-49a1-a608-704b1dbe5a63 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:13.892919 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-99d50b0f-8b7b-49a1-a608-704b1dbe5a63 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:13.900392 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-99d50b0f-8b7b-49a1-a608-704b1dbe5a63 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:13.900847 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-99d50b0f-8b7b-49a1-a608-704b1dbe5a63 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:13.902405 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-99d50b0f-8b7b-49a1-a608-704b1dbe5a63 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:13.903228 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-99d50b0f-8b7b-49a1-a608-704b1dbe5a63 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:13.983653 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-99d50b0f-8b7b-49a1-a608-704b1dbe5a63 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 14 microversion: 2.1 time: 0.095631 Nov 23 07:44:13.984719 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 89/171] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:13 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 07:44:14.005323 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5208b1b2-01f7-4077-9251-3bdb8218fb08 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:14.005912 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-164f80ad-b325-4a5d-b739-86743bbd6160 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:14.006540 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-164f80ad-b325-4a5d-b739-86743bbd6160 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:14.015088 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-164f80ad-b325-4a5d-b739-86743bbd6160 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:14.015792 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-164f80ad-b325-4a5d-b739-86743bbd6160 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:14.016736 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-164f80ad-b325-4a5d-b739-86743bbd6160 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:14.017404 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-164f80ad-b325-4a5d-b739-86743bbd6160 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:14.019428 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5208b1b2-01f7-4077-9251-3bdb8218fb08 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:14.046389 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5208b1b2-01f7-4077-9251-3bdb8218fb08 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:14.050148 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5208b1b2-01f7-4077-9251-3bdb8218fb08 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:14.053230 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5208b1b2-01f7-4077-9251-3bdb8218fb08 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:14.057901 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5208b1b2-01f7-4077-9251-3bdb8218fb08 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:14.162993 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5208b1b2-01f7-4077-9251-3bdb8218fb08 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 14 microversion: 2.20 time: 0.178289 Nov 23 07:44:14.166463 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 83/172] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:13 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:14.216098 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-164f80ad-b325-4a5d-b739-86743bbd6160 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:14.223938 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-164f80ad-b325-4a5d-b739-86743bbd6160 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.223001 Nov 23 07:44:14.225070 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 90/173] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:13 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:14.998620 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-1a4916be-b20c-4c4f-a536-5843ee6225cb tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:14.999675 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-1a4916be-b20c-4c4f-a536-5843ee6225cb tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:15.006794 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1a4916be-b20c-4c4f-a536-5843ee6225cb tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:15.008079 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1a4916be-b20c-4c4f-a536-5843ee6225cb tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:15.008903 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1a4916be-b20c-4c4f-a536-5843ee6225cb tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:15.009345 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1a4916be-b20c-4c4f-a536-5843ee6225cb tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:15.083596 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-1a4916be-b20c-4c4f-a536-5843ee6225cb tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 14 microversion: 2.1 time: 0.090152 Nov 23 07:44:15.084304 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 84/174] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:14 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:44:15.175175 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d4668ad9-1bff-4118-b0d9-9ed510418cf7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:15.176076 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d4668ad9-1bff-4118-b0d9-9ed510418cf7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:15.183257 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d4668ad9-1bff-4118-b0d9-9ed510418cf7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:15.183702 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d4668ad9-1bff-4118-b0d9-9ed510418cf7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:15.184516 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d4668ad9-1bff-4118-b0d9-9ed510418cf7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:15.184957 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d4668ad9-1bff-4118-b0d9-9ed510418cf7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:15.243639 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-b6e09646-87fe-418c-9561-bf702a565791 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:15.244736 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-b6e09646-87fe-418c-9561-bf702a565791 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:15.251644 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b6e09646-87fe-418c-9561-bf702a565791 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:15.252589 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b6e09646-87fe-418c-9561-bf702a565791 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:15.253368 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b6e09646-87fe-418c-9561-bf702a565791 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:15.253906 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b6e09646-87fe-418c-9561-bf702a565791 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:15.265393 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d4668ad9-1bff-4118-b0d9-9ed510418cf7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 6451 microversion: 2.20 time: 0.093962 Nov 23 07:44:15.267222 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 91/175] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:15 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 6451 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:44:15.412621 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-b6e09646-87fe-418c-9561-bf702a565791 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:15.421555 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-b6e09646-87fe-418c-9561-bf702a565791 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.182086 Nov 23 07:44:15.434081 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 85/176] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:15 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:16.095289 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-19ac60c3-d71b-4aa6-8843-bae90651dfe3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:16.096402 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-19ac60c3-d71b-4aa6-8843-bae90651dfe3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:16.103297 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-19ac60c3-d71b-4aa6-8843-bae90651dfe3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:16.103753 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-19ac60c3-d71b-4aa6-8843-bae90651dfe3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:16.104577 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-19ac60c3-d71b-4aa6-8843-bae90651dfe3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:16.105003 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-19ac60c3-d71b-4aa6-8843-bae90651dfe3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:16.196836 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-19ac60c3-d71b-4aa6-8843-bae90651dfe3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 6017 microversion: 2.1 time: 0.105760 Nov 23 07:44:16.197475 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 92/177] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:16 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 6017 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:16.278443 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-63ad01e7-8ce9-4743-8d28-f9c25c58f5d0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:16.279354 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-63ad01e7-8ce9-4743-8d28-f9c25c58f5d0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:16.285661 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-63ad01e7-8ce9-4743-8d28-f9c25c58f5d0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:16.286150 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-63ad01e7-8ce9-4743-8d28-f9c25c58f5d0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:16.286966 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-63ad01e7-8ce9-4743-8d28-f9c25c58f5d0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:16.287404 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-63ad01e7-8ce9-4743-8d28-f9c25c58f5d0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:16.373012 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-63ad01e7-8ce9-4743-8d28-f9c25c58f5d0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 11207 microversion: 2.20 time: 0.098688 Nov 23 07:44:16.374273 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 86/178] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:16 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 11207 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:44:16.440973 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-bd3ca634-f47b-4ec2-a32f-229ef7b6a08e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:16.443019 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-bd3ca634-f47b-4ec2-a32f-229ef7b6a08e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:16.451125 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bd3ca634-f47b-4ec2-a32f-229ef7b6a08e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:16.451603 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bd3ca634-f47b-4ec2-a32f-229ef7b6a08e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:16.452479 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bd3ca634-f47b-4ec2-a32f-229ef7b6a08e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:16.452945 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bd3ca634-f47b-4ec2-a32f-229ef7b6a08e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:16.607841 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-bd3ca634-f47b-4ec2-a32f-229ef7b6a08e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:16.619266 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-bd3ca634-f47b-4ec2-a32f-229ef7b6a08e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.182223 Nov 23 07:44:16.630081 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 93/179] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:16 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:17.209488 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ab36100b-a553-465f-9222-3f1f1d9ae433 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:17.210818 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ab36100b-a553-465f-9222-3f1f1d9ae433 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:17.219122 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ab36100b-a553-465f-9222-3f1f1d9ae433 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:17.219733 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ab36100b-a553-465f-9222-3f1f1d9ae433 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:17.220551 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ab36100b-a553-465f-9222-3f1f1d9ae433 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:17.221058 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ab36100b-a553-465f-9222-3f1f1d9ae433 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:17.334081 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ab36100b-a553-465f-9222-3f1f1d9ae433 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 10431 microversion: 2.1 time: 0.129259 Nov 23 07:44:17.334758 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 87/180] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:17 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 10431 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:17.384815 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-08a94e49-cded-4e31-ab5b-6883d3f32cda tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:17.385949 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-08a94e49-cded-4e31-ab5b-6883d3f32cda tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:17.392619 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-08a94e49-cded-4e31-ab5b-6883d3f32cda tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:17.393175 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-08a94e49-cded-4e31-ab5b-6883d3f32cda tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:17.394085 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-08a94e49-cded-4e31-ab5b-6883d3f32cda tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:17.394589 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-08a94e49-cded-4e31-ab5b-6883d3f32cda tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:17.482351 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-08a94e49-cded-4e31-ab5b-6883d3f32cda tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 15064 microversion: 2.20 time: 0.101105 Nov 23 07:44:17.483008 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 94/181] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:17 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 15064 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:44:17.637062 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-1d747e85-b117-4fb7-8b9e-fbb357dd795d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:17.637804 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-1d747e85-b117-4fb7-8b9e-fbb357dd795d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:17.644653 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1d747e85-b117-4fb7-8b9e-fbb357dd795d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:17.645102 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1d747e85-b117-4fb7-8b9e-fbb357dd795d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:17.645917 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1d747e85-b117-4fb7-8b9e-fbb357dd795d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:17.646357 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1d747e85-b117-4fb7-8b9e-fbb357dd795d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:17.837743 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-1d747e85-b117-4fb7-8b9e-fbb357dd795d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:17.846595 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-1d747e85-b117-4fb7-8b9e-fbb357dd795d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.213068 Nov 23 07:44:17.848014 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 88/182] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:17 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:18.346809 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e0df7439-3327-4f0d-b731-e93beffbbd42 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:18.347812 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e0df7439-3327-4f0d-b731-e93beffbbd42 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:18.355801 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e0df7439-3327-4f0d-b731-e93beffbbd42 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:18.356249 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e0df7439-3327-4f0d-b731-e93beffbbd42 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:18.357035 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e0df7439-3327-4f0d-b731-e93beffbbd42 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:18.357692 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e0df7439-3327-4f0d-b731-e93beffbbd42 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:18.445864 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e0df7439-3327-4f0d-b731-e93beffbbd42 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 15025 microversion: 2.1 time: 0.102809 Nov 23 07:44:18.447412 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 95/183] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:18 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 15025 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:18.493111 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-bac649d7-eb2a-49fe-aaeb-c760d631a3dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:18.494061 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-bac649d7-eb2a-49fe-aaeb-c760d631a3dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:18.501185 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bac649d7-eb2a-49fe-aaeb-c760d631a3dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:18.501802 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bac649d7-eb2a-49fe-aaeb-c760d631a3dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:18.502602 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bac649d7-eb2a-49fe-aaeb-c760d631a3dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:18.503211 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bac649d7-eb2a-49fe-aaeb-c760d631a3dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:18.595190 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-bac649d7-eb2a-49fe-aaeb-c760d631a3dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 18083 microversion: 2.20 time: 0.105646 Nov 23 07:44:18.597743 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 89/184] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:18 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 18083 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:44:18.864986 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e28ed964-4bae-4b4c-a025-49200c62ea25 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:18.865720 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e28ed964-4bae-4b4c-a025-49200c62ea25 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:18.878072 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e28ed964-4bae-4b4c-a025-49200c62ea25 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:18.878528 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e28ed964-4bae-4b4c-a025-49200c62ea25 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:18.879344 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e28ed964-4bae-4b4c-a025-49200c62ea25 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:18.879784 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e28ed964-4bae-4b4c-a025-49200c62ea25 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:19.092419 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-e28ed964-4bae-4b4c-a025-49200c62ea25 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:19.103420 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e28ed964-4bae-4b4c-a025-49200c62ea25 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.242157 Nov 23 07:44:19.107198 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 96/185] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:18 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:19.459655 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3617040a-4026-49bb-82a7-9d847415a99e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:19.460781 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3617040a-4026-49bb-82a7-9d847415a99e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:19.468078 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3617040a-4026-49bb-82a7-9d847415a99e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:19.468664 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3617040a-4026-49bb-82a7-9d847415a99e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:19.469579 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3617040a-4026-49bb-82a7-9d847415a99e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:19.470047 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3617040a-4026-49bb-82a7-9d847415a99e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:19.610406 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-53dadb80-e83b-473a-aee8-405c62163d36 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:19.611481 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-53dadb80-e83b-473a-aee8-405c62163d36 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:19.618129 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-53dadb80-e83b-473a-aee8-405c62163d36 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:19.619000 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-53dadb80-e83b-473a-aee8-405c62163d36 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:19.620886 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-53dadb80-e83b-473a-aee8-405c62163d36 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:19.621537 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-53dadb80-e83b-473a-aee8-405c62163d36 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:22.330329 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3617040a-4026-49bb-82a7-9d847415a99e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 21344 microversion: 2.1 time: 2.875036 Nov 23 07:44:22.331238 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 90/186] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:19 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 21344 bytes in 2877 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:44:22.336891 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-36a2c469-90f6-4bf9-95cd-4e5df1660457 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:22.337580 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-36a2c469-90f6-4bf9-95cd-4e5df1660457 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:22.345513 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-36a2c469-90f6-4bf9-95cd-4e5df1660457 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:22.346059 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-36a2c469-90f6-4bf9-95cd-4e5df1660457 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:22.346845 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-36a2c469-90f6-4bf9-95cd-4e5df1660457 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:22.347411 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-36a2c469-90f6-4bf9-95cd-4e5df1660457 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:22.352410 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-53dadb80-e83b-473a-aee8-405c62163d36 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 22975 microversion: 2.20 time: 2.747026 Nov 23 07:44:22.353055 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 97/187] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:19 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 22975 bytes in 2749 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:44:22.494066 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-36a2c469-90f6-4bf9-95cd-4e5df1660457 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:22.502134 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-36a2c469-90f6-4bf9-95cd-4e5df1660457 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.169685 Nov 23 07:44:22.502718 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 91/188] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:22 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:23.342506 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6ad9ca8f-ce82-4688-b339-c029ed474290 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:23.343527 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6ad9ca8f-ce82-4688-b339-c029ed474290 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:23.352444 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6ad9ca8f-ce82-4688-b339-c029ed474290 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:23.353054 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6ad9ca8f-ce82-4688-b339-c029ed474290 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:23.353737 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6ad9ca8f-ce82-4688-b339-c029ed474290 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:23.354664 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6ad9ca8f-ce82-4688-b339-c029ed474290 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:23.364724 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c261b698-7776-4217-80e9-5fbc90d3ac22 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:23.365638 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c261b698-7776-4217-80e9-5fbc90d3ac22 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:23.372481 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c261b698-7776-4217-80e9-5fbc90d3ac22 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:23.372930 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c261b698-7776-4217-80e9-5fbc90d3ac22 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:23.373767 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c261b698-7776-4217-80e9-5fbc90d3ac22 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:23.374203 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c261b698-7776-4217-80e9-5fbc90d3ac22 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:23.450246 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6ad9ca8f-ce82-4688-b339-c029ed474290 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 22808 microversion: 2.1 time: 0.111162 Nov 23 07:44:23.452664 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 98/189] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:23 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 22808 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:23.464757 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c261b698-7776-4217-80e9-5fbc90d3ac22 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 23797 microversion: 2.20 time: 0.103438 Nov 23 07:44:23.465460 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 92/190] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:23 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 23797 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:44:23.521202 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a600fb26-5a58-485d-a3ac-5f43effdafd2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:23.522432 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a600fb26-5a58-485d-a3ac-5f43effdafd2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:23.529765 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a600fb26-5a58-485d-a3ac-5f43effdafd2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:23.530597 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a600fb26-5a58-485d-a3ac-5f43effdafd2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:23.531578 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a600fb26-5a58-485d-a3ac-5f43effdafd2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:23.532341 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a600fb26-5a58-485d-a3ac-5f43effdafd2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:23.673313 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a600fb26-5a58-485d-a3ac-5f43effdafd2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:23.681370 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a600fb26-5a58-485d-a3ac-5f43effdafd2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.165047 Nov 23 07:44:23.681968 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 99/191] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:23 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:24.466126 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d3fa3e41-9095-4e19-aa45-e915874b732c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:24.467443 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d3fa3e41-9095-4e19-aa45-e915874b732c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:24.475662 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-491f6fb0-b951-45c6-bdc1-4b1cca519605 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:24.476250 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d3fa3e41-9095-4e19-aa45-e915874b732c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:24.476703 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d3fa3e41-9095-4e19-aa45-e915874b732c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:24.477495 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d3fa3e41-9095-4e19-aa45-e915874b732c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:24.477715 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-491f6fb0-b951-45c6-bdc1-4b1cca519605 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:24.477960 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d3fa3e41-9095-4e19-aa45-e915874b732c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:24.485573 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-491f6fb0-b951-45c6-bdc1-4b1cca519605 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:24.486061 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-491f6fb0-b951-45c6-bdc1-4b1cca519605 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:24.486883 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-491f6fb0-b951-45c6-bdc1-4b1cca519605 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:24.487317 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-491f6fb0-b951-45c6-bdc1-4b1cca519605 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:24.559807 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d3fa3e41-9095-4e19-aa45-e915874b732c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 23233 microversion: 2.1 time: 0.100270 Nov 23 07:44:24.563565 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 93/192] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:24 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 23233 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:24.575174 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-491f6fb0-b951-45c6-bdc1-4b1cca519605 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 24359 microversion: 2.20 time: 0.103041 Nov 23 07:44:24.578887 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 100/193] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:24 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 24359 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:44:24.699828 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-fbee2fa0-b4e8-4621-8bfc-931d8a6f23c1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:24.700830 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-fbee2fa0-b4e8-4621-8bfc-931d8a6f23c1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:24.707937 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fbee2fa0-b4e8-4621-8bfc-931d8a6f23c1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:24.708383 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fbee2fa0-b4e8-4621-8bfc-931d8a6f23c1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:24.709163 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fbee2fa0-b4e8-4621-8bfc-931d8a6f23c1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:24.709592 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fbee2fa0-b4e8-4621-8bfc-931d8a6f23c1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:24.851255 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-fbee2fa0-b4e8-4621-8bfc-931d8a6f23c1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:24.860069 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-fbee2fa0-b4e8-4621-8bfc-931d8a6f23c1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.165292 Nov 23 07:44:24.860645 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 94/194] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:24 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:25.572140 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-87cab6af-d629-469e-a16f-bd1913b9af28 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:25.573209 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-87cab6af-d629-469e-a16f-bd1913b9af28 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:25.580350 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-87cab6af-d629-469e-a16f-bd1913b9af28 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:25.580876 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-87cab6af-d629-469e-a16f-bd1913b9af28 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:25.581955 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-87cab6af-d629-469e-a16f-bd1913b9af28 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:25.582382 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-87cab6af-d629-469e-a16f-bd1913b9af28 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:25.586284 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f3e47fe1-c69d-4c59-8c58-735f8a72e7c8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:25.587189 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f3e47fe1-c69d-4c59-8c58-735f8a72e7c8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:25.593367 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f3e47fe1-c69d-4c59-8c58-735f8a72e7c8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:25.593856 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f3e47fe1-c69d-4c59-8c58-735f8a72e7c8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:25.594631 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f3e47fe1-c69d-4c59-8c58-735f8a72e7c8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:25.595054 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f3e47fe1-c69d-4c59-8c58-735f8a72e7c8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:27.544800 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-87cab6af-d629-469e-a16f-bd1913b9af28 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 26006 microversion: 2.1 time: 1.976797 Nov 23 07:44:27.545645 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 101/195] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:25 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 26006 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:27.550321 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-0fbbfefd-a637-44ed-bd0e-5c1874e919da tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:27.551012 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-0fbbfefd-a637-44ed-bd0e-5c1874e919da tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:27.558386 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0fbbfefd-a637-44ed-bd0e-5c1874e919da tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:27.558837 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0fbbfefd-a637-44ed-bd0e-5c1874e919da tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:27.559612 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0fbbfefd-a637-44ed-bd0e-5c1874e919da tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:27.560049 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0fbbfefd-a637-44ed-bd0e-5c1874e919da tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:27.580973 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f3e47fe1-c69d-4c59-8c58-735f8a72e7c8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 26465 microversion: 2.20 time: 1.998121 Nov 23 07:44:27.585259 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 95/196] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:25 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 26465 bytes in 2000 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:44:27.703314 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-0fbbfefd-a637-44ed-bd0e-5c1874e919da tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:27.710540 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-0fbbfefd-a637-44ed-bd0e-5c1874e919da tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.163916 Nov 23 07:44:27.711096 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 102/197] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:27 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:28.556523 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ee46321f-d81a-4054-8fdf-0330dd5f9096 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:28.558145 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ee46321f-d81a-4054-8fdf-0330dd5f9096 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:28.564907 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ee46321f-d81a-4054-8fdf-0330dd5f9096 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:28.565354 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ee46321f-d81a-4054-8fdf-0330dd5f9096 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:28.566156 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ee46321f-d81a-4054-8fdf-0330dd5f9096 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:28.566592 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ee46321f-d81a-4054-8fdf-0330dd5f9096 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:28.592360 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-52e5ceaf-159a-4a64-be99-2e705023b41f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:28.593922 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-52e5ceaf-159a-4a64-be99-2e705023b41f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:28.600455 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-52e5ceaf-159a-4a64-be99-2e705023b41f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:28.600902 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-52e5ceaf-159a-4a64-be99-2e705023b41f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:28.601739 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-52e5ceaf-159a-4a64-be99-2e705023b41f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:28.602182 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-52e5ceaf-159a-4a64-be99-2e705023b41f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:28.648567 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ee46321f-d81a-4054-8fdf-0330dd5f9096 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 26847 microversion: 2.1 time: 0.095813 Nov 23 07:44:28.649219 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 96/198] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:28 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 26847 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:28.696874 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-52e5ceaf-159a-4a64-be99-2e705023b41f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 27149 microversion: 2.20 time: 0.107790 Nov 23 07:44:28.698601 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 103/199] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:28 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 27149 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:44:28.728805 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-9e52592e-d7cd-44b9-9f38-57674f1e05f6 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:28.730224 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-9e52592e-d7cd-44b9-9f38-57674f1e05f6 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:28.737454 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9e52592e-d7cd-44b9-9f38-57674f1e05f6 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:28.738395 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9e52592e-d7cd-44b9-9f38-57674f1e05f6 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:28.739387 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9e52592e-d7cd-44b9-9f38-57674f1e05f6 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:28.740005 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9e52592e-d7cd-44b9-9f38-57674f1e05f6 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:28.909652 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-9e52592e-d7cd-44b9-9f38-57674f1e05f6 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:28.917912 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-9e52592e-d7cd-44b9-9f38-57674f1e05f6 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.192966 Nov 23 07:44:28.919534 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 97/200] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:28 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:29.662220 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-450d9ef0-de86-4a52-aa87-d3f02e13984a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:29.663280 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-450d9ef0-de86-4a52-aa87-d3f02e13984a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:29.671033 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-450d9ef0-de86-4a52-aa87-d3f02e13984a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:29.671482 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-450d9ef0-de86-4a52-aa87-d3f02e13984a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:29.672272 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-450d9ef0-de86-4a52-aa87-d3f02e13984a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:29.672712 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-450d9ef0-de86-4a52-aa87-d3f02e13984a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:29.708321 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-1ac9ee16-c554-43b4-b5e0-97403e9ce36d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:29.709226 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-1ac9ee16-c554-43b4-b5e0-97403e9ce36d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:29.716251 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1ac9ee16-c554-43b4-b5e0-97403e9ce36d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:29.716690 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1ac9ee16-c554-43b4-b5e0-97403e9ce36d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:29.717475 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1ac9ee16-c554-43b4-b5e0-97403e9ce36d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:29.717933 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1ac9ee16-c554-43b4-b5e0-97403e9ce36d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:32.006307 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-450d9ef0-de86-4a52-aa87-d3f02e13984a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 27842 microversion: 2.1 time: 2.347989 Nov 23 07:44:32.010416 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 104/201] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:29 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 27842 bytes in 2350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:32.012073 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-f2e80575-1bd1-466e-a666-8545fbf63b68 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:32.012746 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f2e80575-1bd1-466e-a666-8545fbf63b68 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:32.020131 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f2e80575-1bd1-466e-a666-8545fbf63b68 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:32.020626 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f2e80575-1bd1-466e-a666-8545fbf63b68 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:32.021348 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f2e80575-1bd1-466e-a666-8545fbf63b68 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:32.021805 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f2e80575-1bd1-466e-a666-8545fbf63b68 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:32.036335 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-1ac9ee16-c554-43b4-b5e0-97403e9ce36d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 27838 microversion: 2.20 time: 2.331552 Nov 23 07:44:32.037782 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 98/202] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:29 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 27838 bytes in 2334 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:44:32.181029 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-f2e80575-1bd1-466e-a666-8545fbf63b68 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:32.193812 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-f2e80575-1bd1-466e-a666-8545fbf63b68 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.185273 Nov 23 07:44:32.194489 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 105/203] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:32 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:33.017908 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-49b33333-a0e1-4a78-9279-ac619dd02ce3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:33.019649 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-49b33333-a0e1-4a78-9279-ac619dd02ce3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:33.032766 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-49b33333-a0e1-4a78-9279-ac619dd02ce3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:33.033292 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-49b33333-a0e1-4a78-9279-ac619dd02ce3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:33.034372 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-49b33333-a0e1-4a78-9279-ac619dd02ce3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:33.034812 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-49b33333-a0e1-4a78-9279-ac619dd02ce3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:33.049213 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8b40485b-41c0-4e19-9f2e-a6abc0742d19 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:33.051190 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8b40485b-41c0-4e19-9f2e-a6abc0742d19 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:33.063159 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8b40485b-41c0-4e19-9f2e-a6abc0742d19 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:33.063609 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8b40485b-41c0-4e19-9f2e-a6abc0742d19 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:33.064430 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8b40485b-41c0-4e19-9f2e-a6abc0742d19 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:33.064892 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8b40485b-41c0-4e19-9f2e-a6abc0742d19 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:35.596794 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-49b33333-a0e1-4a78-9279-ac619dd02ce3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 28203 microversion: 2.1 time: 2.582942 Nov 23 07:44:35.597495 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 99/204] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:33 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 28203 bytes in 2585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:35.602306 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-1be011e8-4d18-4a65-99a1-fe7f421ee706 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:35.603001 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-1be011e8-4d18-4a65-99a1-fe7f421ee706 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:35.610406 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1be011e8-4d18-4a65-99a1-fe7f421ee706 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:35.610856 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1be011e8-4d18-4a65-99a1-fe7f421ee706 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:35.611634 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1be011e8-4d18-4a65-99a1-fe7f421ee706 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:35.612071 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1be011e8-4d18-4a65-99a1-fe7f421ee706 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:35.617322 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-8b40485b-41c0-4e19-9f2e-a6abc0742d19 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 28083 microversion: 2.20 time: 2.571742 Nov 23 07:44:35.623258 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 106/205] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:33 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 28083 bytes in 2573 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:44:35.767278 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-1be011e8-4d18-4a65-99a1-fe7f421ee706 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:35.775821 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-1be011e8-4d18-4a65-99a1-fe7f421ee706 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.177095 Nov 23 07:44:35.776420 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 100/206] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:35 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:36.609680 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-3221614c-e2f6-4549-863d-e29a5ae550ef tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:36.610716 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-3221614c-e2f6-4549-863d-e29a5ae550ef tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:36.617803 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3221614c-e2f6-4549-863d-e29a5ae550ef tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:36.618308 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3221614c-e2f6-4549-863d-e29a5ae550ef tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:36.619005 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3221614c-e2f6-4549-863d-e29a5ae550ef tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:36.619430 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3221614c-e2f6-4549-863d-e29a5ae550ef tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:36.630841 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-7a8da385-68c1-4dfd-b404-1f170c8e5069 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:36.631743 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-7a8da385-68c1-4dfd-b404-1f170c8e5069 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:36.638435 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7a8da385-68c1-4dfd-b404-1f170c8e5069 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:36.638923 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7a8da385-68c1-4dfd-b404-1f170c8e5069 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:36.639744 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7a8da385-68c1-4dfd-b404-1f170c8e5069 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:36.640172 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7a8da385-68c1-4dfd-b404-1f170c8e5069 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:38.846752 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-3221614c-e2f6-4549-863d-e29a5ae550ef tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 28203 microversion: 2.1 time: 2.241071 Nov 23 07:44:38.847402 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 107/207] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:36 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 28203 bytes in 2243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:38.852166 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ade7586f-4390-479a-afad-f5dfc5a198f1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:38.852864 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ade7586f-4390-479a-afad-f5dfc5a198f1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:38.860844 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ade7586f-4390-479a-afad-f5dfc5a198f1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:38.861289 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ade7586f-4390-479a-afad-f5dfc5a198f1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:38.862084 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ade7586f-4390-479a-afad-f5dfc5a198f1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:38.862514 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ade7586f-4390-479a-afad-f5dfc5a198f1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:38.873338 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-7a8da385-68c1-4dfd-b404-1f170c8e5069 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 28200 microversion: 2.20 time: 2.245980 Nov 23 07:44:38.874026 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 101/208] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:36 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 28200 bytes in 2247 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:44:38.994730 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ade7586f-4390-479a-afad-f5dfc5a198f1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:39.002209 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ade7586f-4390-479a-afad-f5dfc5a198f1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.153708 Nov 23 07:44:39.002878 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 108/209] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:38 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:39.859310 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-fc35fba1-7438-401f-9be5-88e1a6a4db2f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:39.860332 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-fc35fba1-7438-401f-9be5-88e1a6a4db2f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:39.867277 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fc35fba1-7438-401f-9be5-88e1a6a4db2f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:39.867724 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fc35fba1-7438-401f-9be5-88e1a6a4db2f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:39.868598 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fc35fba1-7438-401f-9be5-88e1a6a4db2f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:39.869041 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fc35fba1-7438-401f-9be5-88e1a6a4db2f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:39.884686 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-77c1e07d-225a-4394-9fdc-a0a1a36685d0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:39.885807 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-77c1e07d-225a-4394-9fdc-a0a1a36685d0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:39.892967 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-77c1e07d-225a-4394-9fdc-a0a1a36685d0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:39.893201 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-77c1e07d-225a-4394-9fdc-a0a1a36685d0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:39.893990 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-77c1e07d-225a-4394-9fdc-a0a1a36685d0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:39.894323 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-77c1e07d-225a-4394-9fdc-a0a1a36685d0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:39.939562 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-fc35fba1-7438-401f-9be5-88e1a6a4db2f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 28203 microversion: 2.1 time: 0.084034 Nov 23 07:44:39.940215 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 102/210] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:39 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 28203 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:39.963094 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-77c1e07d-225a-4394-9fdc-a0a1a36685d0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 28200 microversion: 2.20 time: 0.082185 Nov 23 07:44:39.964465 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 109/211] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:39 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 28200 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:44:40.019728 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f8c1e94e-23f1-409d-b624-26c99d4d904d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:40.020422 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f8c1e94e-23f1-409d-b624-26c99d4d904d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:40.027933 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f8c1e94e-23f1-409d-b624-26c99d4d904d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:40.028570 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f8c1e94e-23f1-409d-b624-26c99d4d904d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:40.029262 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f8c1e94e-23f1-409d-b624-26c99d4d904d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:40.029730 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f8c1e94e-23f1-409d-b624-26c99d4d904d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:40.166208 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f8c1e94e-23f1-409d-b624-26c99d4d904d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:40.174493 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f8c1e94e-23f1-409d-b624-26c99d4d904d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.158731 Nov 23 07:44:40.175067 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 103/212] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:40 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:40.951931 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ecbbdb72-5716-40d9-a9c8-c8e53e326829 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:40.953082 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ecbbdb72-5716-40d9-a9c8-c8e53e326829 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:40.959960 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ecbbdb72-5716-40d9-a9c8-c8e53e326829 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:40.960635 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ecbbdb72-5716-40d9-a9c8-c8e53e326829 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:40.961438 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ecbbdb72-5716-40d9-a9c8-c8e53e326829 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:40.961869 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ecbbdb72-5716-40d9-a9c8-c8e53e326829 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:40.975944 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-318c4fa0-0f91-42a1-9877-bf7f52edd60b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:40.977203 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-318c4fa0-0f91-42a1-9877-bf7f52edd60b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:40.985183 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-318c4fa0-0f91-42a1-9877-bf7f52edd60b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:40.985627 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-318c4fa0-0f91-42a1-9877-bf7f52edd60b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:40.986677 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-318c4fa0-0f91-42a1-9877-bf7f52edd60b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:40.987487 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-318c4fa0-0f91-42a1-9877-bf7f52edd60b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:42.942160 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ecbbdb72-5716-40d9-a9c8-c8e53e326829 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 28203 microversion: 2.1 time: 1.994021 Nov 23 07:44:42.942793 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 110/213] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:40 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 28203 bytes in 1996 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:42.948383 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-318c4fa0-0f91-42a1-9877-bf7f52edd60b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 28200 microversion: 2.20 time: 1.976891 Nov 23 07:44:42.956053 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 104/214] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:40 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 28200 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:44:42.960257 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-2cd18fbd-0069-4f76-83eb-5b4a50a37747 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:42.960955 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-2cd18fbd-0069-4f76-83eb-5b4a50a37747 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:42.970718 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2cd18fbd-0069-4f76-83eb-5b4a50a37747 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:42.970718 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2cd18fbd-0069-4f76-83eb-5b4a50a37747 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:42.971326 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2cd18fbd-0069-4f76-83eb-5b4a50a37747 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:42.971930 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2cd18fbd-0069-4f76-83eb-5b4a50a37747 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:43.118322 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2cd18fbd-0069-4f76-83eb-5b4a50a37747 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:43.125889 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-2cd18fbd-0069-4f76-83eb-5b4a50a37747 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.181550 Nov 23 07:44:43.126458 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 111/215] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:42 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:43.955641 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-aa16f99c-3eef-44bf-9208-8a7f427e3372 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:43.956533 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-aa16f99c-3eef-44bf-9208-8a7f427e3372 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:43.961557 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-68da28a3-254e-40e8-9761-f3e0ccd1e72e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:43.962587 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-68da28a3-254e-40e8-9761-f3e0ccd1e72e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:43.964248 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aa16f99c-3eef-44bf-9208-8a7f427e3372 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:43.964879 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aa16f99c-3eef-44bf-9208-8a7f427e3372 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:43.965672 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aa16f99c-3eef-44bf-9208-8a7f427e3372 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:43.966134 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aa16f99c-3eef-44bf-9208-8a7f427e3372 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:43.970456 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-68da28a3-254e-40e8-9761-f3e0ccd1e72e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:43.971325 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-68da28a3-254e-40e8-9761-f3e0ccd1e72e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:43.972207 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-68da28a3-254e-40e8-9761-f3e0ccd1e72e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:43.972867 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-68da28a3-254e-40e8-9761-f3e0ccd1e72e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:44.041937 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-aa16f99c-3eef-44bf-9208-8a7f427e3372 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 28203 microversion: 2.1 time: 0.087807 Nov 23 07:44:44.041937 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 105/216] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:43 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 28203 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:44.047517 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-68da28a3-254e-40e8-9761-f3e0ccd1e72e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 28200 microversion: 2.20 time: 0.090912 Nov 23 07:44:44.049740 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 112/217] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:43 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 28200 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:44:44.143850 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f054c677-1a3b-42a7-8ed8-0a7349d9c64f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:44.144654 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f054c677-1a3b-42a7-8ed8-0a7349d9c64f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:44.153809 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f054c677-1a3b-42a7-8ed8-0a7349d9c64f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:44.154472 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f054c677-1a3b-42a7-8ed8-0a7349d9c64f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:44.155265 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f054c677-1a3b-42a7-8ed8-0a7349d9c64f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:44.155693 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f054c677-1a3b-42a7-8ed8-0a7349d9c64f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:44.305475 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f054c677-1a3b-42a7-8ed8-0a7349d9c64f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:44.313452 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f054c677-1a3b-42a7-8ed8-0a7349d9c64f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.173817 Nov 23 07:44:44.314135 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 106/218] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:44 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:45.051315 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c4c90c2c-caef-4b53-aa6d-934317dcb735 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:45.052417 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c4c90c2c-caef-4b53-aa6d-934317dcb735 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:45.061139 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c4c90c2c-caef-4b53-aa6d-934317dcb735 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:45.061472 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-aea2af7c-7c3c-45ae-8715-5c5f9ab4babd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:45.062203 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c4c90c2c-caef-4b53-aa6d-934317dcb735 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:45.063048 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c4c90c2c-caef-4b53-aa6d-934317dcb735 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:45.063296 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-aea2af7c-7c3c-45ae-8715-5c5f9ab4babd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:45.063490 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c4c90c2c-caef-4b53-aa6d-934317dcb735 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:45.082643 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aea2af7c-7c3c-45ae-8715-5c5f9ab4babd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:45.083097 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aea2af7c-7c3c-45ae-8715-5c5f9ab4babd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:45.084438 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aea2af7c-7c3c-45ae-8715-5c5f9ab4babd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:45.085094 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aea2af7c-7c3c-45ae-8715-5c5f9ab4babd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:45.162539 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c4c90c2c-caef-4b53-aa6d-934317dcb735 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 28494 microversion: 2.1 time: 0.114903 Nov 23 07:44:45.163803 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 113/219] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:45 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 28494 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:45.179603 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-aea2af7c-7c3c-45ae-8715-5c5f9ab4babd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 28490 microversion: 2.20 time: 0.123365 Nov 23 07:44:45.182959 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 107/220] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:45 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 28490 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:44:45.332220 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e7b25f71-8ac4-41b9-82a8-b436e6801d69 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:45.333046 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e7b25f71-8ac4-41b9-82a8-b436e6801d69 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:45.342856 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e7b25f71-8ac4-41b9-82a8-b436e6801d69 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:45.342984 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e7b25f71-8ac4-41b9-82a8-b436e6801d69 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:45.343892 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e7b25f71-8ac4-41b9-82a8-b436e6801d69 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:45.344543 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e7b25f71-8ac4-41b9-82a8-b436e6801d69 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:45.491952 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-e7b25f71-8ac4-41b9-82a8-b436e6801d69 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:45.499708 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e7b25f71-8ac4-41b9-82a8-b436e6801d69 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.171483 Nov 23 07:44:45.500667 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 114/221] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:45 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:44:46.175415 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f7c3c0da-8084-4e8e-9957-60a49a343f8e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:46.176412 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f7c3c0da-8084-4e8e-9957-60a49a343f8e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:46.183965 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f7c3c0da-8084-4e8e-9957-60a49a343f8e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:46.184416 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f7c3c0da-8084-4e8e-9957-60a49a343f8e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:46.185194 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f7c3c0da-8084-4e8e-9957-60a49a343f8e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:46.185628 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f7c3c0da-8084-4e8e-9957-60a49a343f8e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:46.194664 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1c28825a-b8ab-4fda-b8a4-d1e1f1126338 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:46.195600 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1c28825a-b8ab-4fda-b8a4-d1e1f1126338 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:46.203899 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1c28825a-b8ab-4fda-b8a4-d1e1f1126338 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:46.204689 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1c28825a-b8ab-4fda-b8a4-d1e1f1126338 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:46.205836 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1c28825a-b8ab-4fda-b8a4-d1e1f1126338 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:46.206392 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1c28825a-b8ab-4fda-b8a4-d1e1f1126338 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:46.255462 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f7c3c0da-8084-4e8e-9957-60a49a343f8e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 28494 microversion: 2.1 time: 0.083965 Nov 23 07:44:46.256213 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 108/222] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:46 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 28494 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:46.282162 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1c28825a-b8ab-4fda-b8a4-d1e1f1126338 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 28490 microversion: 2.20 time: 0.091106 Nov 23 07:44:46.286105 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 115/223] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:46 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 28490 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:44:46.517409 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d08655cb-d01d-42c1-97e1-dffbca7f8369 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:46.518127 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d08655cb-d01d-42c1-97e1-dffbca7f8369 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:46.525145 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d08655cb-d01d-42c1-97e1-dffbca7f8369 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:46.525611 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d08655cb-d01d-42c1-97e1-dffbca7f8369 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:46.526550 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d08655cb-d01d-42c1-97e1-dffbca7f8369 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:46.526985 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d08655cb-d01d-42c1-97e1-dffbca7f8369 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:46.672364 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d08655cb-d01d-42c1-97e1-dffbca7f8369 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:46.680568 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d08655cb-d01d-42c1-97e1-dffbca7f8369 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1521 microversion: 2.1 time: 0.167021 Nov 23 07:44:46.681494 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 109/224] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:46 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:47.267883 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d666c515-0001-4b4f-a64b-737fcba4bcf4 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:47.269665 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d666c515-0001-4b4f-a64b-737fcba4bcf4 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:47.277254 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d666c515-0001-4b4f-a64b-737fcba4bcf4 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:47.277800 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d666c515-0001-4b4f-a64b-737fcba4bcf4 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:47.278653 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d666c515-0001-4b4f-a64b-737fcba4bcf4 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:47.279142 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d666c515-0001-4b4f-a64b-737fcba4bcf4 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:47.295737 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-905ddc13-7903-4953-82ec-3273802ada05 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:47.299568 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-905ddc13-7903-4953-82ec-3273802ada05 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:47.308999 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-905ddc13-7903-4953-82ec-3273802ada05 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:47.309794 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-905ddc13-7903-4953-82ec-3273802ada05 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:47.310663 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-905ddc13-7903-4953-82ec-3273802ada05 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:47.311170 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-905ddc13-7903-4953-82ec-3273802ada05 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:47.382877 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d666c515-0001-4b4f-a64b-737fcba4bcf4 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 28661 microversion: 2.1 time: 0.118894 Nov 23 07:44:47.384339 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 116/225] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:47 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 28661 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:44:47.415048 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-905ddc13-7903-4953-82ec-3273802ada05 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 28657 microversion: 2.20 time: 0.124557 Nov 23 07:44:47.415836 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 110/226] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:47 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 28657 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:44:47.698967 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-f18eb648-57b0-4c8e-b96a-24a53d2f4b64 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:47.699848 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f18eb648-57b0-4c8e-b96a-24a53d2f4b64 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:47.706827 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f18eb648-57b0-4c8e-b96a-24a53d2f4b64 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:47.707391 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f18eb648-57b0-4c8e-b96a-24a53d2f4b64 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:47.708285 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f18eb648-57b0-4c8e-b96a-24a53d2f4b64 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:47.709023 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f18eb648-57b0-4c8e-b96a-24a53d2f4b64 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:47.890706 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-f18eb648-57b0-4c8e-b96a-24a53d2f4b64 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:47.898492 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-f18eb648-57b0-4c8e-b96a-24a53d2f4b64 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1501 microversion: 2.1 time: 0.204166 Nov 23 07:44:47.899222 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 117/227] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:47 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1501 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:47.917347 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-767c1a1d-690c-48b9-9cf6-76b34db21888 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:47.918082 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-767c1a1d-690c-48b9-9cf6-76b34db21888 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:47.925299 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-767c1a1d-690c-48b9-9cf6-76b34db21888 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:47.925767 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-767c1a1d-690c-48b9-9cf6-76b34db21888 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:47.926593 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-767c1a1d-690c-48b9-9cf6-76b34db21888 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:47.927243 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-767c1a1d-690c-48b9-9cf6-76b34db21888 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:48.166046 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-767c1a1d-690c-48b9-9cf6-76b34db21888 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:48.175892 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-767c1a1d-690c-48b9-9cf6-76b34db21888 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1516 microversion: 2.1 time: 0.262759 Nov 23 07:44:48.176487 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 111/228] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:47 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1516 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:44:48.395883 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-394ad229-0455-4a08-b944-08e773703a24 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:48.396885 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-394ad229-0455-4a08-b944-08e773703a24 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:48.412581 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-394ad229-0455-4a08-b944-08e773703a24 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:48.413441 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-394ad229-0455-4a08-b944-08e773703a24 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:48.414424 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-394ad229-0455-4a08-b944-08e773703a24 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:48.415286 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-394ad229-0455-4a08-b944-08e773703a24 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:48.428148 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c1fe8ee4-fdb2-4790-a1d4-f305a98f04d1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:48.429745 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c1fe8ee4-fdb2-4790-a1d4-f305a98f04d1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:48.449642 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c1fe8ee4-fdb2-4790-a1d4-f305a98f04d1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:48.450138 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c1fe8ee4-fdb2-4790-a1d4-f305a98f04d1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:48.451023 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c1fe8ee4-fdb2-4790-a1d4-f305a98f04d1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:48.451377 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c1fe8ee4-fdb2-4790-a1d4-f305a98f04d1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:48.568330 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-394ad229-0455-4a08-b944-08e773703a24 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 28661 microversion: 2.1 time: 0.176155 Nov 23 07:44:48.569530 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 118/229] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:48 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 28661 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:48.574606 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c1fe8ee4-fdb2-4790-a1d4-f305a98f04d1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 28657 microversion: 2.20 time: 0.150782 Nov 23 07:44:48.575625 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 112/230] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:48 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 28657 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:44:49.585990 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a120b77b-6497-45e2-bfc5-03ef3bc25a6e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:49.587795 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a120b77b-6497-45e2-bfc5-03ef3bc25a6e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:49.590665 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-0e3fd695-f4da-4930-ab07-7b2ed5dc10cc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:49.592645 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-0e3fd695-f4da-4930-ab07-7b2ed5dc10cc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:49.597492 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a120b77b-6497-45e2-bfc5-03ef3bc25a6e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:49.597971 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a120b77b-6497-45e2-bfc5-03ef3bc25a6e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:49.598787 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a120b77b-6497-45e2-bfc5-03ef3bc25a6e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:49.599644 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a120b77b-6497-45e2-bfc5-03ef3bc25a6e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:49.602907 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0e3fd695-f4da-4930-ab07-7b2ed5dc10cc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:49.603691 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0e3fd695-f4da-4930-ab07-7b2ed5dc10cc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:49.604767 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0e3fd695-f4da-4930-ab07-7b2ed5dc10cc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:49.605430 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0e3fd695-f4da-4930-ab07-7b2ed5dc10cc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:49.683432 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a120b77b-6497-45e2-bfc5-03ef3bc25a6e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 28661 microversion: 2.1 time: 0.105039 Nov 23 07:44:49.684099 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 119/231] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:49 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 28661 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:44:49.688057 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-0e3fd695-f4da-4930-ab07-7b2ed5dc10cc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 28657 microversion: 2.20 time: 0.105376 Nov 23 07:44:49.689080 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 113/232] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:49 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 28657 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:44:49.759553 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-fc7ecd1a-7ab7-4d95-8918-74a9f6e879dc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:49.762197 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-fc7ecd1a-7ab7-4d95-8918-74a9f6e879dc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:49.779119 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fc7ecd1a-7ab7-4d95-8918-74a9f6e879dc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:49.779303 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fc7ecd1a-7ab7-4d95-8918-74a9f6e879dc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:49.781066 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fc7ecd1a-7ab7-4d95-8918-74a9f6e879dc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:49.782219 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fc7ecd1a-7ab7-4d95-8918-74a9f6e879dc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:49.813000 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.objects.instance [None req-fc7ecd1a-7ab7-4d95-8918-74a9f6e879dc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lazy-loading 'flavor' on Instance uuid c5cba5f7-c9fd-4708-923c-deec6ab27cdd {{(pid=122786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:44:49.929471 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-fc7ecd1a-7ab7-4d95-8918-74a9f6e879dc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "POST /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/action" status: 200 len: 32 microversion: 2.1 time: 0.174176 Nov 23 07:44:49.930185 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 120/233] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:49 2021] POST /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:44:49.947358 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d2a044d2-d8d2-4b88-8143-d2c48c2f22d8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:49.949204 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d2a044d2-d8d2-4b88-8143-d2c48c2f22d8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:49.960021 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d2a044d2-d8d2-4b88-8143-d2c48c2f22d8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:49.962434 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d2a044d2-d8d2-4b88-8143-d2c48c2f22d8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:49.963917 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d2a044d2-d8d2-4b88-8143-d2c48c2f22d8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:49.964356 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d2a044d2-d8d2-4b88-8143-d2c48c2f22d8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:50.371675 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d2a044d2-d8d2-4b88-8143-d2c48c2f22d8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:50.379691 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d2a044d2-d8d2-4b88-8143-d2c48c2f22d8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1522 microversion: 2.1 time: 0.443672 Nov 23 07:44:50.380815 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 114/234] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:49 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:50.698946 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ee774f5f-7504-4306-9a68-25f40b423012 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:50.699612 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-58031e07-67bc-44eb-8f49-44469b392c98 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:50.699981 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ee774f5f-7504-4306-9a68-25f40b423012 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:50.700122 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-58031e07-67bc-44eb-8f49-44469b392c98 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:50.710144 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ee774f5f-7504-4306-9a68-25f40b423012 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:50.710988 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ee774f5f-7504-4306-9a68-25f40b423012 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:50.712028 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ee774f5f-7504-4306-9a68-25f40b423012 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:50.712717 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ee774f5f-7504-4306-9a68-25f40b423012 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:50.715975 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-58031e07-67bc-44eb-8f49-44469b392c98 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:50.716428 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-58031e07-67bc-44eb-8f49-44469b392c98 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:50.717233 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-58031e07-67bc-44eb-8f49-44469b392c98 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:50.717660 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-58031e07-67bc-44eb-8f49-44469b392c98 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:50.788558 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ee774f5f-7504-4306-9a68-25f40b423012 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 28657 microversion: 2.20 time: 0.093068 Nov 23 07:44:50.793524 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 115/235] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:50 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 28657 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:44:50.819933 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-58031e07-67bc-44eb-8f49-44469b392c98 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 28661 microversion: 2.1 time: 0.127501 Nov 23 07:44:50.824480 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 121/236] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:50 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 28661 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:51.358403 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-86d3ec77-48b8-4741-8e11-971a753fc09a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1125462792", "imageRef": "6895b3b6-16b9-4e43-bf1b-c19e73615ca8", "flavorRef": "452", "networks": [{"uuid": "1d025715-d454-4776-858b-529ffc8c62df"}]}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:51.399104 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-90d0ee06-8048-44f3-b80e-b9499da8cc68 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:51.399797 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-90d0ee06-8048-44f3-b80e-b9499da8cc68 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:51.418141 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-90d0ee06-8048-44f3-b80e-b9499da8cc68 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:51.418589 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-90d0ee06-8048-44f3-b80e-b9499da8cc68 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:51.422687 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-90d0ee06-8048-44f3-b80e-b9499da8cc68 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:51.423335 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-90d0ee06-8048-44f3-b80e-b9499da8cc68 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:51.425200 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.network.neutron [None req-86d3ec77-48b8-4741-8e11-971a753fc09a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] validate_networks() for [('1d025715-d454-4776-858b-529ffc8c62df', None, None, None, None, None)] {{(pid=122785) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:44:51.638823 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-90d0ee06-8048-44f3-b80e-b9499da8cc68 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:51.655082 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-90d0ee06-8048-44f3-b80e-b9499da8cc68 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1522 microversion: 2.1 time: 0.260478 Nov 23 07:44:51.657913 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 122/237] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:51 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:51.665310 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6a1689c9-ed35-4650-a7b7-8bc4471a9cdd tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-679888163", "imageRef": "6895b3b6-16b9-4e43-bf1b-c19e73615ca8", "flavorRef": "452"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:51.736199 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.network.neutron [None req-6a1689c9-ed35-4650-a7b7-8bc4471a9cdd tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] validate_networks() for None {{(pid=122786) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:44:52.161198 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-6a1689c9-ed35-4650-a7b7-8bc4471a9cdd tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Flavor limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:44:52.161631 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-6a1689c9-ed35-4650-a7b7-8bc4471a9cdd tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Image limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:44:52.162136 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-6a1689c9-ed35-4650-a7b7-8bc4471a9cdd tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Flavor pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:44:52.162547 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-6a1689c9-ed35-4650-a7b7-8bc4471a9cdd tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Image pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:44:52.162961 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-6a1689c9-ed35-4650-a7b7-8bc4471a9cdd tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:44:52.174137 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6a1689c9-ed35-4650-a7b7-8bc4471a9cdd tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:52.174790 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6a1689c9-ed35-4650-a7b7-8bc4471a9cdd tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:52.175769 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6a1689c9-ed35-4650-a7b7-8bc4471a9cdd tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:52.176349 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6a1689c9-ed35-4650-a7b7-8bc4471a9cdd tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:52.196875 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-6a1689c9-ed35-4650-a7b7-8bc4471a9cdd tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Getting quotas for project 723e5a0d62d44a78bc5e939f77759f86. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:44:52.202439 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-6a1689c9-ed35-4650-a7b7-8bc4471a9cdd tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Getting quotas for user 44cc02ee9bb049108541e15d65a80aae and project 723e5a0d62d44a78bc5e939f77759f86. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:44:52.216327 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6a1689c9-ed35-4650-a7b7-8bc4471a9cdd tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Going to run 1 instances... {{(pid=122786) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:44:52.219121 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6a1689c9-ed35-4650-a7b7-8bc4471a9cdd tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6895b3b6-16b9-4e43-bf1b-c19e73615ca8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:44:52.276575 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6a1689c9-ed35-4650-a7b7-8bc4471a9cdd tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617046 Nov 23 07:44:52.277599 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 123/238] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Nov 23 07:44:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 07:44:52.292804 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-3335f2e9-7253-42d9-8e96-956879d22b19 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:52.305211 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-3335f2e9-7253-42d9-8e96-956879d22b19 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:52.316079 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3335f2e9-7253-42d9-8e96-956879d22b19 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:52.317210 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3335f2e9-7253-42d9-8e96-956879d22b19 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:52.318194 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3335f2e9-7253-42d9-8e96-956879d22b19 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:52.318776 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3335f2e9-7253-42d9-8e96-956879d22b19 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:52.420591 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-86d3ec77-48b8-4741-8e11-971a753fc09a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Flavor limits 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:44:52.421084 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-86d3ec77-48b8-4741-8e11-971a753fc09a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Image limits 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:44:52.421563 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-86d3ec77-48b8-4741-8e11-971a753fc09a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Flavor pref 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:44:52.422282 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-86d3ec77-48b8-4741-8e11-971a753fc09a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Image pref 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:44:52.423515 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-86d3ec77-48b8-4741-8e11-971a753fc09a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:44:52.425307 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-3335f2e9-7253-42d9-8e96-956879d22b19 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 30395 microversion: 2.20 time: 0.146241 Nov 23 07:44:52.426248 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 124/239] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:52 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 30395 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:44:52.435339 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4df0f2b0-88b2-4133-abe8-0d8d7dd951dc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:52.437285 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4df0f2b0-88b2-4133-abe8-0d8d7dd951dc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:52.462827 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-86d3ec77-48b8-4741-8e11-971a753fc09a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:52.467953 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-86d3ec77-48b8-4741-8e11-971a753fc09a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:52.468993 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-86d3ec77-48b8-4741-8e11-971a753fc09a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:52.470199 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-86d3ec77-48b8-4741-8e11-971a753fc09a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:52.478066 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4df0f2b0-88b2-4133-abe8-0d8d7dd951dc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:52.480385 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4df0f2b0-88b2-4133-abe8-0d8d7dd951dc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:52.482977 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4df0f2b0-88b2-4133-abe8-0d8d7dd951dc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:52.483843 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4df0f2b0-88b2-4133-abe8-0d8d7dd951dc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:52.516648 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-86d3ec77-48b8-4741-8e11-971a753fc09a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Getting quotas for project 8c9142ed0ac74c31a3d2b005076861fb. Resources: {'instances', 'cores', 'ram'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:44:52.533306 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-86d3ec77-48b8-4741-8e11-971a753fc09a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Getting quotas for user f602e0688ca74408a1de8431ceb40649 and project 8c9142ed0ac74c31a3d2b005076861fb. Resources: {'instances', 'cores', 'ram'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:44:52.550004 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-86d3ec77-48b8-4741-8e11-971a753fc09a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Going to run 1 instances... {{(pid=122785) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:44:52.554836 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-86d3ec77-48b8-4741-8e11-971a753fc09a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: b8fcc6a6-9265-4035-8a04-5c154de90d80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6895b3b6-16b9-4e43-bf1b-c19e73615ca8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:44:52.620977 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4df0f2b0-88b2-4133-abe8-0d8d7dd951dc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 29918 microversion: 2.1 time: 0.193073 Nov 23 07:44:52.621639 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 125/240] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:52 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 29918 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:52.629087 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-dea6d30c-486e-4c51-b973-e2b990679865 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:52.629878 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-dea6d30c-486e-4c51-b973-e2b990679865 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:52.630024 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-86d3ec77-48b8-4741-8e11-971a753fc09a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.275772 Nov 23 07:44:52.636785 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 116/241] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Nov 23 07:44:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 07:44:52.642122 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-4ad837f7-a94a-42c7-9684-be0b770c60b7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:52.642964 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-4ad837f7-a94a-42c7-9684-be0b770c60b7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: b8fcc6a6-9265-4035-8a04-5c154de90d80] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:52.716330 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-4ad837f7-a94a-42c7-9684-be0b770c60b7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:52.736148 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-4ad837f7-a94a-42c7-9684-be0b770c60b7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80" status: 200 len: 1214 microversion: 2.1 time: 0.087521 Nov 23 07:44:52.739036 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 117/242] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:52 2021] GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:52.766428 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-62e2bb7f-0eaf-4483-a26e-c7d6692429e0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:52.767059 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-62e2bb7f-0eaf-4483-a26e-c7d6692429e0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:52.787051 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-62e2bb7f-0eaf-4483-a26e-c7d6692429e0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:52.790764 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-62e2bb7f-0eaf-4483-a26e-c7d6692429e0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:52.793909 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-62e2bb7f-0eaf-4483-a26e-c7d6692429e0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:52.794660 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-62e2bb7f-0eaf-4483-a26e-c7d6692429e0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:52.797154 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-dea6d30c-486e-4c51-b973-e2b990679865 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc02ee9bb049108541e15d65a80aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723e5a0d62d44a78bc5e939f77759f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:52.811745 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-dea6d30c-486e-4c51-b973-e2b990679865 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 200 len: 1214 microversion: 2.1 time: 0.188782 Nov 23 07:44:52.813281 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 126/243] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:52 2021] GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 1214 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:53.205391 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-62e2bb7f-0eaf-4483-a26e-c7d6692429e0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:53.217507 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-62e2bb7f-0eaf-4483-a26e-c7d6692429e0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1522 microversion: 2.1 time: 0.473906 Nov 23 07:44:53.218928 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 118/244] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:52 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:53.437935 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a89bc72f-72bb-413a-a31f-305daaa7ce81 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:53.439117 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a89bc72f-72bb-413a-a31f-305daaa7ce81 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:53.449765 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a89bc72f-72bb-413a-a31f-305daaa7ce81 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:53.450820 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a89bc72f-72bb-413a-a31f-305daaa7ce81 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:53.455278 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a89bc72f-72bb-413a-a31f-305daaa7ce81 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:53.457007 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a89bc72f-72bb-413a-a31f-305daaa7ce81 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:53.613531 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a89bc72f-72bb-413a-a31f-305daaa7ce81 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 31496 microversion: 2.20 time: 0.179853 Nov 23 07:44:53.615355 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 127/245] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:53 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 31496 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:44:53.633493 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f88e8fbc-d551-47d2-8c61-d0939101f519 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:53.635366 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f88e8fbc-d551-47d2-8c61-d0939101f519 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:53.641949 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f88e8fbc-d551-47d2-8c61-d0939101f519 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:53.642671 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f88e8fbc-d551-47d2-8c61-d0939101f519 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:53.643623 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f88e8fbc-d551-47d2-8c61-d0939101f519 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:53.644437 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f88e8fbc-d551-47d2-8c61-d0939101f519 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:53.747901 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f88e8fbc-d551-47d2-8c61-d0939101f519 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 31129 microversion: 2.1 time: 0.117848 Nov 23 07:44:53.755259 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-f10bfe7b-6a0f-4485-8144-e4a817e1771f tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:53.756648 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 119/246] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:53 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 31129 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:53.759601 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f10bfe7b-6a0f-4485-8144-e4a817e1771f tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: b8fcc6a6-9265-4035-8a04-5c154de90d80] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:53.768550 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f10bfe7b-6a0f-4485-8144-e4a817e1771f tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:53.769076 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f10bfe7b-6a0f-4485-8144-e4a817e1771f tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:53.770524 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f10bfe7b-6a0f-4485-8144-e4a817e1771f tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:53.771547 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f10bfe7b-6a0f-4485-8144-e4a817e1771f tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:53.835855 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-af1c4c2f-0ec6-4ce8-83ef-8e306bd9109b tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:53.836637 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-af1c4c2f-0ec6-4ce8-83ef-8e306bd9109b tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:53.845979 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-af1c4c2f-0ec6-4ce8-83ef-8e306bd9109b tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:53.846644 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-af1c4c2f-0ec6-4ce8-83ef-8e306bd9109b tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:53.847661 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-af1c4c2f-0ec6-4ce8-83ef-8e306bd9109b tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:53.848279 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-af1c4c2f-0ec6-4ce8-83ef-8e306bd9109b tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:53.849628 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-f10bfe7b-6a0f-4485-8144-e4a817e1771f tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:53.864097 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-f10bfe7b-6a0f-4485-8144-e4a817e1771f tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80" status: 200 len: 1210 microversion: 2.1 time: 0.113661 Nov 23 07:44:53.877119 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 128/247] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:53 2021] GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80 => generated 1210 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:53.931929 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-af1c4c2f-0ec6-4ce8-83ef-8e306bd9109b tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc02ee9bb049108541e15d65a80aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723e5a0d62d44a78bc5e939f77759f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:53.941209 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-af1c4c2f-0ec6-4ce8-83ef-8e306bd9109b tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 200 len: 1266 microversion: 2.1 time: 0.111544 Nov 23 07:44:53.952249 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 120/248] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:53 2021] GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:54.237078 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4c1f1bb8-af40-440c-b68a-880408c7653b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:54.238379 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4c1f1bb8-af40-440c-b68a-880408c7653b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:54.255276 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4c1f1bb8-af40-440c-b68a-880408c7653b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:54.255736 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4c1f1bb8-af40-440c-b68a-880408c7653b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:54.256606 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4c1f1bb8-af40-440c-b68a-880408c7653b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:54.257057 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4c1f1bb8-af40-440c-b68a-880408c7653b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:54.526528 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-4c1f1bb8-af40-440c-b68a-880408c7653b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:54.546119 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4c1f1bb8-af40-440c-b68a-880408c7653b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1522 microversion: 2.1 time: 0.303485 Nov 23 07:44:54.548608 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 129/249] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:54 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:54.627667 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-49169544-5a94-4e14-9974-574ce7827784 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:54.628989 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-49169544-5a94-4e14-9974-574ce7827784 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:54.644554 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-49169544-5a94-4e14-9974-574ce7827784 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:54.645102 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-49169544-5a94-4e14-9974-574ce7827784 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:54.652275 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-49169544-5a94-4e14-9974-574ce7827784 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:54.652988 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-49169544-5a94-4e14-9974-574ce7827784 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:54.771923 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-49169544-5a94-4e14-9974-574ce7827784 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 32187 microversion: 2.20 time: 0.149529 Nov 23 07:44:54.778215 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 121/250] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:54 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 32187 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:44:54.778452 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-f33f84d1-6602-4936-9210-62d52b9cf4eb tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:54.778452 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f33f84d1-6602-4936-9210-62d52b9cf4eb tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:54.795879 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f33f84d1-6602-4936-9210-62d52b9cf4eb tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:54.796337 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f33f84d1-6602-4936-9210-62d52b9cf4eb tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:54.798262 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f33f84d1-6602-4936-9210-62d52b9cf4eb tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:54.802718 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f33f84d1-6602-4936-9210-62d52b9cf4eb tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:54.881886 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-fef750c5-5e35-410a-9537-fad976d8a054 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:54.882991 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-fef750c5-5e35-410a-9537-fad976d8a054 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: b8fcc6a6-9265-4035-8a04-5c154de90d80] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:54.901661 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fef750c5-5e35-410a-9537-fad976d8a054 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:54.904127 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fef750c5-5e35-410a-9537-fad976d8a054 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:54.906687 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fef750c5-5e35-410a-9537-fad976d8a054 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:54.910156 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fef750c5-5e35-410a-9537-fad976d8a054 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:54.922852 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-f33f84d1-6602-4936-9210-62d52b9cf4eb tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 32284 microversion: 2.1 time: 0.158842 Nov 23 07:44:54.936509 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 130/251] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:54 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 32284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:44:54.970952 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-38651636-c829-4e3a-8006-b1f3e635c94c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:54.971955 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-38651636-c829-4e3a-8006-b1f3e635c94c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:54.998401 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-38651636-c829-4e3a-8006-b1f3e635c94c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:55.001695 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-38651636-c829-4e3a-8006-b1f3e635c94c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:55.007173 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-38651636-c829-4e3a-8006-b1f3e635c94c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:55.007745 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-38651636-c829-4e3a-8006-b1f3e635c94c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:55.136516 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-38651636-c829-4e3a-8006-b1f3e635c94c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc02ee9bb049108541e15d65a80aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723e5a0d62d44a78bc5e939f77759f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:55.147347 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-38651636-c829-4e3a-8006-b1f3e635c94c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 200 len: 1272 microversion: 2.1 time: 0.181747 Nov 23 07:44:55.165778 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 131/252] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:54 2021] GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:55.197185 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-fef750c5-5e35-410a-9537-fad976d8a054 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:55.209026 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-fef750c5-5e35-410a-9537-fad976d8a054 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80" status: 200 len: 1272 microversion: 2.1 time: 0.331147 Nov 23 07:44:55.210189 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 122/253] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:54 2021] GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80 => generated 1272 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:44:55.564517 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-202f1544-e907-4c16-a3e3-6f9c3db19ff2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:55.565854 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-202f1544-e907-4c16-a3e3-6f9c3db19ff2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:55.574429 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-202f1544-e907-4c16-a3e3-6f9c3db19ff2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:55.575295 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-202f1544-e907-4c16-a3e3-6f9c3db19ff2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:55.576566 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-202f1544-e907-4c16-a3e3-6f9c3db19ff2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:55.577274 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-202f1544-e907-4c16-a3e3-6f9c3db19ff2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:55.794505 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ce438d14-2d5a-47a1-a5c6-7a8d4fc9a47f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:55.796210 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ce438d14-2d5a-47a1-a5c6-7a8d4fc9a47f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:55.821019 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ce438d14-2d5a-47a1-a5c6-7a8d4fc9a47f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:55.821463 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ce438d14-2d5a-47a1-a5c6-7a8d4fc9a47f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:55.827223 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ce438d14-2d5a-47a1-a5c6-7a8d4fc9a47f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:55.827680 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ce438d14-2d5a-47a1-a5c6-7a8d4fc9a47f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:55.938353 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ce438d14-2d5a-47a1-a5c6-7a8d4fc9a47f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 32978 microversion: 2.20 time: 0.152910 Nov 23 07:44:55.938878 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 123/254] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:55 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 32978 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:44:55.948440 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-99d9fe60-6d45-4f88-867a-3f2277afc07c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:55.955052 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-99d9fe60-6d45-4f88-867a-3f2277afc07c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:55.974055 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-99d9fe60-6d45-4f88-867a-3f2277afc07c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:55.974496 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-99d9fe60-6d45-4f88-867a-3f2277afc07c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:55.975291 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-99d9fe60-6d45-4f88-867a-3f2277afc07c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:55.975718 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-99d9fe60-6d45-4f88-867a-3f2277afc07c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:56.019995 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-202f1544-e907-4c16-a3e3-6f9c3db19ff2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:56.039321 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-202f1544-e907-4c16-a3e3-6f9c3db19ff2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1522 microversion: 2.1 time: 0.467812 Nov 23 07:44:56.044767 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 132/255] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:55 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1522 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:56.112254 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-99d9fe60-6d45-4f88-867a-3f2277afc07c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 33363 microversion: 2.1 time: 0.167958 Nov 23 07:44:56.113223 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 124/256] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:55 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 33363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:56.175125 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-fc1922ca-9b23-44bf-9fa5-2600f5cb7a76 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:56.176151 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-fc1922ca-9b23-44bf-9fa5-2600f5cb7a76 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:56.190640 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fc1922ca-9b23-44bf-9fa5-2600f5cb7a76 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:56.191368 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fc1922ca-9b23-44bf-9fa5-2600f5cb7a76 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:56.214920 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fc1922ca-9b23-44bf-9fa5-2600f5cb7a76 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:56.215673 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fc1922ca-9b23-44bf-9fa5-2600f5cb7a76 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:56.228288 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-6a97b65f-d988-481a-9ddb-f1ec884f5d57 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:56.230442 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-6a97b65f-d988-481a-9ddb-f1ec884f5d57 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: b8fcc6a6-9265-4035-8a04-5c154de90d80] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:56.255254 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6a97b65f-d988-481a-9ddb-f1ec884f5d57 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:56.256461 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6a97b65f-d988-481a-9ddb-f1ec884f5d57 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:56.258078 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6a97b65f-d988-481a-9ddb-f1ec884f5d57 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:56.259284 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6a97b65f-d988-481a-9ddb-f1ec884f5d57 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:56.729616 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-6a97b65f-d988-481a-9ddb-f1ec884f5d57 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:56.740300 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-6a97b65f-d988-481a-9ddb-f1ec884f5d57 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80" status: 200 len: 1314 microversion: 2.1 time: 0.517024 Nov 23 07:44:56.750393 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 125/257] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:56 2021] GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80 => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:56.800914 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-fc1922ca-9b23-44bf-9fa5-2600f5cb7a76 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc02ee9bb049108541e15d65a80aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723e5a0d62d44a78bc5e939f77759f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:56.809435 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-fc1922ca-9b23-44bf-9fa5-2600f5cb7a76 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 200 len: 1314 microversion: 2.1 time: 0.640805 Nov 23 07:44:56.810169 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 133/258] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:56 2021] GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:56.956873 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5d633a61-a92b-4035-acba-0cd263914142 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:56.958501 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5d633a61-a92b-4035-acba-0cd263914142 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:56.974009 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5d633a61-a92b-4035-acba-0cd263914142 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:56.974569 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5d633a61-a92b-4035-acba-0cd263914142 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:56.975475 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5d633a61-a92b-4035-acba-0cd263914142 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:56.978256 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5d633a61-a92b-4035-acba-0cd263914142 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:57.062531 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-20c6ecc8-c25f-4403-9845-2a6806170620 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:57.063804 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-20c6ecc8-c25f-4403-9845-2a6806170620 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:57.069257 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5d633a61-a92b-4035-acba-0cd263914142 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 33806 microversion: 2.20 time: 0.122406 Nov 23 07:44:57.071386 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 126/259] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:56 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 33806 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:44:57.079436 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-20c6ecc8-c25f-4403-9845-2a6806170620 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:57.079938 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-20c6ecc8-c25f-4403-9845-2a6806170620 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:57.080774 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-20c6ecc8-c25f-4403-9845-2a6806170620 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:57.081621 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-20c6ecc8-c25f-4403-9845-2a6806170620 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:57.125395 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-8d9f053a-6c69-45e2-bd8f-4581a2bbb8d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:57.126694 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-8d9f053a-6c69-45e2-bd8f-4581a2bbb8d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:57.139866 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8d9f053a-6c69-45e2-bd8f-4581a2bbb8d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:57.141153 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8d9f053a-6c69-45e2-bd8f-4581a2bbb8d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:57.142269 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8d9f053a-6c69-45e2-bd8f-4581a2bbb8d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:57.143170 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8d9f053a-6c69-45e2-bd8f-4581a2bbb8d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:57.253578 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-8d9f053a-6c69-45e2-bd8f-4581a2bbb8d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 34080 microversion: 2.1 time: 0.132383 Nov 23 07:44:57.255317 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 127/260] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:57 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 34080 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:44:57.288589 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-20c6ecc8-c25f-4403-9845-2a6806170620 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:57.299186 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-20c6ecc8-c25f-4403-9845-2a6806170620 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1522 microversion: 2.1 time: 0.242022 Nov 23 07:44:57.300490 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 134/261] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:57 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:57.760362 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-40dbea30-1271-4c93-b50d-81419829bbc9 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:57.761171 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-40dbea30-1271-4c93-b50d-81419829bbc9 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: b8fcc6a6-9265-4035-8a04-5c154de90d80] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:57.789008 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40dbea30-1271-4c93-b50d-81419829bbc9 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:57.789008 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40dbea30-1271-4c93-b50d-81419829bbc9 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:57.795970 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40dbea30-1271-4c93-b50d-81419829bbc9 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:57.799535 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40dbea30-1271-4c93-b50d-81419829bbc9 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:57.827724 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-fb70c665-ba6b-4aed-b1db-cb1e123c2571 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:57.828469 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-fb70c665-ba6b-4aed-b1db-cb1e123c2571 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:57.853654 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fb70c665-ba6b-4aed-b1db-cb1e123c2571 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:57.855236 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fb70c665-ba6b-4aed-b1db-cb1e123c2571 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:57.862092 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fb70c665-ba6b-4aed-b1db-cb1e123c2571 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:57.863832 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fb70c665-ba6b-4aed-b1db-cb1e123c2571 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:58.178669 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-fb70c665-ba6b-4aed-b1db-cb1e123c2571 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc02ee9bb049108541e15d65a80aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723e5a0d62d44a78bc5e939f77759f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:58.187263 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-fb70c665-ba6b-4aed-b1db-cb1e123c2571 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 200 len: 1314 microversion: 2.1 time: 0.363399 Nov 23 07:44:58.193516 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 135/262] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:57 2021] GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:44:58.198846 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-2e96f509-3dc3-4bbf-9c5d-c75bbe620a68 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:58.210583 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-2e96f509-3dc3-4bbf-9c5d-c75bbe620a68 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:58.231092 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2e96f509-3dc3-4bbf-9c5d-c75bbe620a68 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:58.231881 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2e96f509-3dc3-4bbf-9c5d-c75bbe620a68 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:58.236978 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2e96f509-3dc3-4bbf-9c5d-c75bbe620a68 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:58.237425 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2e96f509-3dc3-4bbf-9c5d-c75bbe620a68 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:58.369560 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-2e96f509-3dc3-4bbf-9c5d-c75bbe620a68 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 35258 microversion: 2.20 time: 0.174386 Nov 23 07:44:58.370270 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 136/263] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:58 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 35258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:44:58.377849 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-a2e7573d-687e-412d-94c9-5e4113b9be44 req-c3ae32bd-b728-4fdc-8655-8dad8ee6cde6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8fcc6a6-9265-4035-8a04-5c154de90d80", "tag": "08e13f9c-b230-4488-b77a-25b20c843475"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:58.391613 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:44:58.391613 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:44:58.410621 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-a2e7573d-687e-412d-94c9-5e4113b9be44 req-c3ae32bd-b728-4fdc-8655-8dad8ee6cde6 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:58.411355 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-a2e7573d-687e-412d-94c9-5e4113b9be44 req-c3ae32bd-b728-4fdc-8655-8dad8ee6cde6 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:58.434921 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-a2e7573d-687e-412d-94c9-5e4113b9be44 req-c3ae32bd-b728-4fdc-8655-8dad8ee6cde6 service nova] Creating event network-changed:08e13f9c-b230-4488-b77a-25b20c843475 for instance b8fcc6a6-9265-4035-8a04-5c154de90d80 on hv-cinder-80403 Nov 23 07:44:58.448585 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-a2e7573d-687e-412d-94c9-5e4113b9be44 req-c3ae32bd-b728-4fdc-8655-8dad8ee6cde6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076001 Nov 23 07:44:58.449512 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 137/264] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:44:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:44:58.467162 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d99f5a1f-ff0d-4ee4-85e9-001ccdc80cce tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:58.468206 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d99f5a1f-ff0d-4ee4-85e9-001ccdc80cce tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:58.474402 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d99f5a1f-ff0d-4ee4-85e9-001ccdc80cce tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:58.474858 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d99f5a1f-ff0d-4ee4-85e9-001ccdc80cce tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:58.475664 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d99f5a1f-ff0d-4ee4-85e9-001ccdc80cce tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:58.476107 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d99f5a1f-ff0d-4ee4-85e9-001ccdc80cce tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:58.570860 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-40dbea30-1271-4c93-b50d-81419829bbc9 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:58.582702 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-40dbea30-1271-4c93-b50d-81419829bbc9 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80" status: 200 len: 1314 microversion: 2.1 time: 0.827966 Nov 23 07:44:58.588343 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d99f5a1f-ff0d-4ee4-85e9-001ccdc80cce tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 35036 microversion: 2.1 time: 0.136976 Nov 23 07:44:58.589066 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 128/265] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:57 2021] GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80 => generated 1314 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:58.590328 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 138/266] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:58 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 35036 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:44:58.608536 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-145f46a0-fd46-49cf-a3eb-4dda48a1bcd1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:58.609205 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-145f46a0-fd46-49cf-a3eb-4dda48a1bcd1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:58.629661 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-145f46a0-fd46-49cf-a3eb-4dda48a1bcd1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:58.630429 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-145f46a0-fd46-49cf-a3eb-4dda48a1bcd1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:58.631530 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-145f46a0-fd46-49cf-a3eb-4dda48a1bcd1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:58.632192 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-145f46a0-fd46-49cf-a3eb-4dda48a1bcd1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:59.137550 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-145f46a0-fd46-49cf-a3eb-4dda48a1bcd1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:59.150893 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-145f46a0-fd46-49cf-a3eb-4dda48a1bcd1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1522 microversion: 2.1 time: 0.559145 Nov 23 07:44:59.151841 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 129/267] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:58 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1522 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:59.214082 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-12df754e-d5ee-4559-b053-fed96a42bf17 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:59.217872 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-12df754e-d5ee-4559-b053-fed96a42bf17 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:59.228493 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-12df754e-d5ee-4559-b053-fed96a42bf17 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:59.229771 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-12df754e-d5ee-4559-b053-fed96a42bf17 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:59.230881 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-12df754e-d5ee-4559-b053-fed96a42bf17 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:59.231467 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-12df754e-d5ee-4559-b053-fed96a42bf17 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:59.387333 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-08ba9d34-05f5-4772-b214-96e665b3386f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:59.388841 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-08ba9d34-05f5-4772-b214-96e665b3386f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:59.421060 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-08ba9d34-05f5-4772-b214-96e665b3386f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:59.423753 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-08ba9d34-05f5-4772-b214-96e665b3386f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:59.426331 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-08ba9d34-05f5-4772-b214-96e665b3386f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:59.430496 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-08ba9d34-05f5-4772-b214-96e665b3386f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:59.508289 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-12df754e-d5ee-4559-b053-fed96a42bf17 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc02ee9bb049108541e15d65a80aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723e5a0d62d44a78bc5e939f77759f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:44:59.516952 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-12df754e-d5ee-4559-b053-fed96a42bf17 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 200 len: 1314 microversion: 2.1 time: 0.310752 Nov 23 07:44:59.520019 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 139/268] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:59 2021] GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:44:59.551604 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-08ba9d34-05f5-4772-b214-96e665b3386f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 36313 microversion: 2.20 time: 0.172868 Nov 23 07:44:59.554148 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 130/269] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:44:59 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 36313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:44:59.605751 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-6ebc8ad4-1443-4f1a-9b2c-3f90a8a94058 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:44:59.605751 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-6ebc8ad4-1443-4f1a-9b2c-3f90a8a94058 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: b8fcc6a6-9265-4035-8a04-5c154de90d80] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:59.617562 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6ebc8ad4-1443-4f1a-9b2c-3f90a8a94058 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:59.622301 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6ebc8ad4-1443-4f1a-9b2c-3f90a8a94058 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:59.623635 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6ebc8ad4-1443-4f1a-9b2c-3f90a8a94058 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:59.624322 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6ebc8ad4-1443-4f1a-9b2c-3f90a8a94058 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:59.635979 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ca4aad77-96e2-4a84-a686-f6e15e58fe38 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:44:59.641291 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ca4aad77-96e2-4a84-a686-f6e15e58fe38 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:44:59.676908 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ca4aad77-96e2-4a84-a686-f6e15e58fe38 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:59.677356 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ca4aad77-96e2-4a84-a686-f6e15e58fe38 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:59.678182 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ca4aad77-96e2-4a84-a686-f6e15e58fe38 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:44:59.678614 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ca4aad77-96e2-4a84-a686-f6e15e58fe38 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:44:59.822983 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ca4aad77-96e2-4a84-a686-f6e15e58fe38 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 35806 microversion: 2.1 time: 0.213325 Nov 23 07:44:59.827422 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 140/270] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:44:59 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 35806 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:45:00.057463 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-6ebc8ad4-1443-4f1a-9b2c-3f90a8a94058 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:00.079359 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-6ebc8ad4-1443-4f1a-9b2c-3f90a8a94058 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80" status: 200 len: 1314 microversion: 2.1 time: 0.478923 Nov 23 07:45:00.080804 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 131/271] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:44:59 2021] GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:00.187902 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-5d375ab6-19cb-41ac-907e-a905b6dc7525 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:00.188866 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-5d375ab6-19cb-41ac-907e-a905b6dc7525 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:00.201493 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5d375ab6-19cb-41ac-907e-a905b6dc7525 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:00.202257 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5d375ab6-19cb-41ac-907e-a905b6dc7525 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:00.203252 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5d375ab6-19cb-41ac-907e-a905b6dc7525 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:00.204968 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5d375ab6-19cb-41ac-907e-a905b6dc7525 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:00.477755 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-2d281660-bdf6-4dd5-8b69-a8984efa52a4 req-f1d90ee6-aeef-4927-94cc-cf0a83a27df2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "257f9b12-bb8a-4024-98e9-1b4372267afb", "tag": "cae966e3-c326-4a3a-8326-de8bd1225127"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:00.479779 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:45:00.479779 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:45:00.492468 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-2d281660-bdf6-4dd5-8b69-a8984efa52a4 req-f1d90ee6-aeef-4927-94cc-cf0a83a27df2 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:00.498006 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-2d281660-bdf6-4dd5-8b69-a8984efa52a4 req-f1d90ee6-aeef-4927-94cc-cf0a83a27df2 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:00.517503 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-2d281660-bdf6-4dd5-8b69-a8984efa52a4 req-f1d90ee6-aeef-4927-94cc-cf0a83a27df2 service nova] Creating event network-changed:cae966e3-c326-4a3a-8326-de8bd1225127 for instance 257f9b12-bb8a-4024-98e9-1b4372267afb on hv-cinder-80403 Nov 23 07:45:00.532830 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-2d281660-bdf6-4dd5-8b69-a8984efa52a4 req-f1d90ee6-aeef-4927-94cc-cf0a83a27df2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058158 Nov 23 07:45:00.535444 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 132/272] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:45:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:45:00.547704 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-1ce2670b-dda9-48b1-8704-54e8bbe665f4 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:00.553150 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-1ce2670b-dda9-48b1-8704-54e8bbe665f4 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:00.570136 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1ce2670b-dda9-48b1-8704-54e8bbe665f4 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:00.572096 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1ce2670b-dda9-48b1-8704-54e8bbe665f4 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:00.573364 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1ce2670b-dda9-48b1-8704-54e8bbe665f4 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:00.578350 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1ce2670b-dda9-48b1-8704-54e8bbe665f4 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:00.802714 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5d375ab6-19cb-41ac-907e-a905b6dc7525 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:00.813618 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-5d375ab6-19cb-41ac-907e-a905b6dc7525 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1522 microversion: 2.1 time: 0.632899 Nov 23 07:45:00.817452 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 141/273] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:00 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1522 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:00.837397 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-2f84b17f-2469-46b3-86e3-2363dc0e20be tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:00.844739 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-2f84b17f-2469-46b3-86e3-2363dc0e20be tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:00.874481 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2f84b17f-2469-46b3-86e3-2363dc0e20be tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:00.875026 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2f84b17f-2469-46b3-86e3-2363dc0e20be tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:00.875964 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2f84b17f-2469-46b3-86e3-2363dc0e20be tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:00.876508 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2f84b17f-2469-46b3-86e3-2363dc0e20be tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:00.888380 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-1ce2670b-dda9-48b1-8704-54e8bbe665f4 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc02ee9bb049108541e15d65a80aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723e5a0d62d44a78bc5e939f77759f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:00.903427 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-1ce2670b-dda9-48b1-8704-54e8bbe665f4 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 200 len: 1314 microversion: 2.1 time: 0.366508 Nov 23 07:45:00.904027 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 133/274] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:00 2021] GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:00.920645 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-b802cb29-2b9a-4d8a-962e-42c306401d5d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:00.921639 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-b802cb29-2b9a-4d8a-962e-42c306401d5d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:00.935204 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b802cb29-2b9a-4d8a-962e-42c306401d5d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:00.935663 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b802cb29-2b9a-4d8a-962e-42c306401d5d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:00.936461 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b802cb29-2b9a-4d8a-962e-42c306401d5d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:00.936903 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b802cb29-2b9a-4d8a-962e-42c306401d5d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:00.996385 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-2f84b17f-2469-46b3-86e3-2363dc0e20be tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 37349 microversion: 2.20 time: 0.172798 Nov 23 07:45:01.001591 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 142/275] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:45:00 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 37349 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:45:01.066871 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-b802cb29-2b9a-4d8a-962e-42c306401d5d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 36847 microversion: 2.1 time: 0.151892 Nov 23 07:45:01.068134 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 134/276] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:45:00 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 36847 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:45:01.099604 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-7e25599a-bb89-4da0-8c86-15f727b9f09e tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:01.100378 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-7e25599a-bb89-4da0-8c86-15f727b9f09e tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: b8fcc6a6-9265-4035-8a04-5c154de90d80] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:01.123502 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7e25599a-bb89-4da0-8c86-15f727b9f09e tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:01.128284 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7e25599a-bb89-4da0-8c86-15f727b9f09e tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:01.129315 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7e25599a-bb89-4da0-8c86-15f727b9f09e tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:01.129815 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7e25599a-bb89-4da0-8c86-15f727b9f09e tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:01.553488 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-7e25599a-bb89-4da0-8c86-15f727b9f09e tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:01.561327 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-7e25599a-bb89-4da0-8c86-15f727b9f09e tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80" status: 200 len: 1314 microversion: 2.1 time: 0.466818 Nov 23 07:45:01.565077 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 143/277] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:01 2021] GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:01.836720 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-523c7f7d-5184-4998-960e-1c64995f699d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:01.837757 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-523c7f7d-5184-4998-960e-1c64995f699d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:01.855099 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-523c7f7d-5184-4998-960e-1c64995f699d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:01.856448 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-523c7f7d-5184-4998-960e-1c64995f699d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:01.857309 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-523c7f7d-5184-4998-960e-1c64995f699d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:01.857791 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-523c7f7d-5184-4998-960e-1c64995f699d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:01.925833 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-313d579e-4fa5-4566-8162-0222738d9ac6 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:01.926451 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-313d579e-4fa5-4566-8162-0222738d9ac6 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:01.935145 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-313d579e-4fa5-4566-8162-0222738d9ac6 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:01.935615 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-313d579e-4fa5-4566-8162-0222738d9ac6 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:01.936406 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-313d579e-4fa5-4566-8162-0222738d9ac6 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:01.936839 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-313d579e-4fa5-4566-8162-0222738d9ac6 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:02.228210 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-523c7f7d-5184-4998-960e-1c64995f699d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:02.253889 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-523c7f7d-5184-4998-960e-1c64995f699d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1522 microversion: 2.1 time: 0.421002 Nov 23 07:45:02.269409 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 135/278] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:01 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:02.277671 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-09a0f353-f64a-41e5-a11e-1b24bd39f57f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:02.280590 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-09a0f353-f64a-41e5-a11e-1b24bd39f57f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:02.287457 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-09a0f353-f64a-41e5-a11e-1b24bd39f57f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:02.288251 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-09a0f353-f64a-41e5-a11e-1b24bd39f57f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:02.290861 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-09a0f353-f64a-41e5-a11e-1b24bd39f57f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:02.291564 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-09a0f353-f64a-41e5-a11e-1b24bd39f57f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:02.296633 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-313d579e-4fa5-4566-8162-0222738d9ac6 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc02ee9bb049108541e15d65a80aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723e5a0d62d44a78bc5e939f77759f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:02.313447 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-313d579e-4fa5-4566-8162-0222738d9ac6 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 200 len: 1314 microversion: 2.1 time: 0.391247 Nov 23 07:45:02.326136 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 144/279] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:01 2021] GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:02.330870 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-469d8ba7-79a6-482b-bdef-8f47c4b4ba04 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:02.331854 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-469d8ba7-79a6-482b-bdef-8f47c4b4ba04 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:02.354797 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-469d8ba7-79a6-482b-bdef-8f47c4b4ba04 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:02.355256 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-469d8ba7-79a6-482b-bdef-8f47c4b4ba04 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:02.356054 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-469d8ba7-79a6-482b-bdef-8f47c4b4ba04 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:02.356491 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-469d8ba7-79a6-482b-bdef-8f47c4b4ba04 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:02.458020 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-09a0f353-f64a-41e5-a11e-1b24bd39f57f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 38195 microversion: 2.20 time: 0.186360 Nov 23 07:45:02.461281 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 136/280] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:45:02 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 38195 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:45:02.510204 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-469d8ba7-79a6-482b-bdef-8f47c4b4ba04 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 38125 microversion: 2.1 time: 0.181742 Nov 23 07:45:02.517177 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-15595c25-2101-4981-b3a7-6d18f9066cd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-684622525", "imageRef": "6895b3b6-16b9-4e43-bf1b-c19e73615ca8", "flavorRef": "452", "networks": [{"uuid": "3750312f-10a6-44d3-9b74-d5b95bc5fc19"}]}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:02.517489 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 145/281] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:45:02 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 38125 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:45:02.588650 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8d4e5da4-48de-469f-8867-ebf6a286fd0b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:02.593377 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8d4e5da4-48de-469f-8867-ebf6a286fd0b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: b8fcc6a6-9265-4035-8a04-5c154de90d80] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:02.614116 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.network.neutron [None req-15595c25-2101-4981-b3a7-6d18f9066cd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] validate_networks() for [('3750312f-10a6-44d3-9b74-d5b95bc5fc19', None, None, None, None, None)] {{(pid=122785) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:45:02.624066 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8d4e5da4-48de-469f-8867-ebf6a286fd0b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:02.626315 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8d4e5da4-48de-469f-8867-ebf6a286fd0b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:02.627154 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8d4e5da4-48de-469f-8867-ebf6a286fd0b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:02.627596 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8d4e5da4-48de-469f-8867-ebf6a286fd0b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:03.097592 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-8d4e5da4-48de-469f-8867-ebf6a286fd0b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:03.106768 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-8d4e5da4-48de-469f-8867-ebf6a286fd0b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80" status: 200 len: 1314 microversion: 2.1 time: 0.527433 Nov 23 07:45:03.110364 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 146/282] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:02 2021] GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:03.279567 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-618996a4-4d88-4de7-b786-3bad132b36ce tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:03.280555 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-618996a4-4d88-4de7-b786-3bad132b36ce tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:03.300202 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-618996a4-4d88-4de7-b786-3bad132b36ce tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:03.301169 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-618996a4-4d88-4de7-b786-3bad132b36ce tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:03.303533 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-618996a4-4d88-4de7-b786-3bad132b36ce tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:03.304197 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-618996a4-4d88-4de7-b786-3bad132b36ce tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:03.352478 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-15595c25-2101-4981-b3a7-6d18f9066cd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Flavor limits 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:45:03.353696 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-15595c25-2101-4981-b3a7-6d18f9066cd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Image limits 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:45:03.354600 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-15595c25-2101-4981-b3a7-6d18f9066cd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Flavor pref 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:45:03.355248 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-15595c25-2101-4981-b3a7-6d18f9066cd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Image pref 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:45:03.355876 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-15595c25-2101-4981-b3a7-6d18f9066cd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:45:03.376652 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-15595c25-2101-4981-b3a7-6d18f9066cd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:03.377735 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-15595c25-2101-4981-b3a7-6d18f9066cd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:03.378858 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-15595c25-2101-4981-b3a7-6d18f9066cd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:03.379530 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-15595c25-2101-4981-b3a7-6d18f9066cd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:03.403060 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-15595c25-2101-4981-b3a7-6d18f9066cd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Getting quotas for project 230efaa941f948e5b6c183a252310eda. Resources: {'instances', 'cores', 'ram'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:45:03.408120 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-15595c25-2101-4981-b3a7-6d18f9066cd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Getting quotas for user a82a3ef8b5604e208e028a5b0386c79f and project 230efaa941f948e5b6c183a252310eda. Resources: {'instances', 'cores', 'ram'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:45:03.426385 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-15595c25-2101-4981-b3a7-6d18f9066cd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Going to run 1 instances... {{(pid=122785) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:45:03.429417 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-15595c25-2101-4981-b3a7-6d18f9066cd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6895b3b6-16b9-4e43-bf1b-c19e73615ca8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:45:03.508767 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-15595c25-2101-4981-b3a7-6d18f9066cd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.005374 Nov 23 07:45:03.510845 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 137/283] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Nov 23 07:45:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 07:45:03.519454 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-6392db2e-d0b3-4aa9-bf9b-2720c02b57f6 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:03.520082 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-6392db2e-d0b3-4aa9-bf9b-2720c02b57f6 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:03.528238 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6392db2e-d0b3-4aa9-bf9b-2720c02b57f6 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:03.528685 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6392db2e-d0b3-4aa9-bf9b-2720c02b57f6 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:03.529536 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6392db2e-d0b3-4aa9-bf9b-2720c02b57f6 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:03.530013 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6392db2e-d0b3-4aa9-bf9b-2720c02b57f6 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:03.824546 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-618996a4-4d88-4de7-b786-3bad132b36ce tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:03.835674 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-618996a4-4d88-4de7-b786-3bad132b36ce tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1522 microversion: 2.1 time: 0.562918 Nov 23 07:45:03.838394 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 147/284] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:03 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1522 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:03.851635 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-5df026cf-907a-4e4d-9b61-d205d98597bd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:03.853017 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-5df026cf-907a-4e4d-9b61-d205d98597bd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:03.866967 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-6392db2e-d0b3-4aa9-bf9b-2720c02b57f6 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc02ee9bb049108541e15d65a80aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723e5a0d62d44a78bc5e939f77759f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:03.876096 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-6392db2e-d0b3-4aa9-bf9b-2720c02b57f6 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 200 len: 1314 microversion: 2.1 time: 0.364091 Nov 23 07:45:03.878419 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5df026cf-907a-4e4d-9b61-d205d98597bd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:03.883838 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 138/285] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:03 2021] GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:03.884639 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5df026cf-907a-4e4d-9b61-d205d98597bd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:03.889364 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-0a8ff9a0-b084-48e9-8a83-028a6f63315c tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:03.890541 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5df026cf-907a-4e4d-9b61-d205d98597bd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:03.891084 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5df026cf-907a-4e4d-9b61-d205d98597bd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:03.902300 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-0a8ff9a0-b084-48e9-8a83-028a6f63315c tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:03.997327 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0a8ff9a0-b084-48e9-8a83-028a6f63315c tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:04.000052 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-5df026cf-907a-4e4d-9b61-d205d98597bd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 38195 microversion: 2.20 time: 0.159830 Nov 23 07:45:04.000801 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 148/286] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:45:03 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 38195 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:45:04.005542 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-0a8ff9a0-b084-48e9-8a83-028a6f63315c tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1218 microversion: 2.1 time: 0.119691 Nov 23 07:45:04.006206 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 139/287] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:03 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:04.014721 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-0e0e06cb-eeca-4281-8699-0cd3c4171c6d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:04.015752 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-0e0e06cb-eeca-4281-8699-0cd3c4171c6d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:04.034122 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0e0e06cb-eeca-4281-8699-0cd3c4171c6d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:04.034573 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0e0e06cb-eeca-4281-8699-0cd3c4171c6d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:04.035376 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0e0e06cb-eeca-4281-8699-0cd3c4171c6d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:04.035813 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0e0e06cb-eeca-4281-8699-0cd3c4171c6d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:04.140596 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-fd293926-1ab6-41f0-a3ff-a9138ea77ec7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:04.144000 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-fd293926-1ab6-41f0-a3ff-a9138ea77ec7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: b8fcc6a6-9265-4035-8a04-5c154de90d80] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:04.154655 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fd293926-1ab6-41f0-a3ff-a9138ea77ec7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:04.155294 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fd293926-1ab6-41f0-a3ff-a9138ea77ec7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:04.156277 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fd293926-1ab6-41f0-a3ff-a9138ea77ec7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:04.156862 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fd293926-1ab6-41f0-a3ff-a9138ea77ec7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:04.165258 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-0e0e06cb-eeca-4281-8699-0cd3c4171c6d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 38178 microversion: 2.1 time: 0.158230 Nov 23 07:45:04.166461 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 149/288] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:45:04 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 38178 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:45:04.492000 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-fd293926-1ab6-41f0-a3ff-a9138ea77ec7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:04.501882 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-fd293926-1ab6-41f0-a3ff-a9138ea77ec7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80" status: 200 len: 1314 microversion: 2.1 time: 0.377781 Nov 23 07:45:04.502475 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 140/289] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:04 2021] GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:04.864841 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-86eaf9df-5ba6-4f76-a093-6dd6b227d9d6 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:04.865971 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-86eaf9df-5ba6-4f76-a093-6dd6b227d9d6 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:04.874108 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-86eaf9df-5ba6-4f76-a093-6dd6b227d9d6 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:04.875138 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-86eaf9df-5ba6-4f76-a093-6dd6b227d9d6 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:04.877284 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-86eaf9df-5ba6-4f76-a093-6dd6b227d9d6 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:04.878880 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-86eaf9df-5ba6-4f76-a093-6dd6b227d9d6 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:04.901189 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-480927d5-7a6c-498b-a4ea-5b6a061f280b tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:04.902084 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-480927d5-7a6c-498b-a4ea-5b6a061f280b tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:04.921340 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-480927d5-7a6c-498b-a4ea-5b6a061f280b tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:04.921831 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-480927d5-7a6c-498b-a4ea-5b6a061f280b tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:04.922800 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-480927d5-7a6c-498b-a4ea-5b6a061f280b tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:04.923494 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-480927d5-7a6c-498b-a4ea-5b6a061f280b tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:05.258780 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-86eaf9df-5ba6-4f76-a093-6dd6b227d9d6 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:05.273270 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-86eaf9df-5ba6-4f76-a093-6dd6b227d9d6 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1522 microversion: 2.1 time: 0.421667 Nov 23 07:45:05.274195 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 150/290] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:04 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:05.280159 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1c0a86e5-f800-467c-8a82-628f559101e6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:05.281418 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1c0a86e5-f800-467c-8a82-628f559101e6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:05.288446 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1c0a86e5-f800-467c-8a82-628f559101e6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:05.289913 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1c0a86e5-f800-467c-8a82-628f559101e6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:05.291001 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1c0a86e5-f800-467c-8a82-628f559101e6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:05.291665 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1c0a86e5-f800-467c-8a82-628f559101e6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:05.414754 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1c0a86e5-f800-467c-8a82-628f559101e6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 200 len: 38336 microversion: 2.20 time: 0.138468 Nov 23 07:45:05.416844 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 151/291] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:45:05 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 38336 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:45:05.423797 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-480927d5-7a6c-498b-a4ea-5b6a061f280b tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc02ee9bb049108541e15d65a80aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723e5a0d62d44a78bc5e939f77759f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:05.437378 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c227fd22-52c4-49fc-a7ef-5b402f213aab tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:05.444011 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c227fd22-52c4-49fc-a7ef-5b402f213aab tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:05.445475 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-480927d5-7a6c-498b-a4ea-5b6a061f280b tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 200 len: 1314 microversion: 2.1 time: 0.548645 Nov 23 07:45:05.449766 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 141/292] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:04 2021] GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:05.454395 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c227fd22-52c4-49fc-a7ef-5b402f213aab tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:05.454841 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c227fd22-52c4-49fc-a7ef-5b402f213aab tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:05.455629 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c227fd22-52c4-49fc-a7ef-5b402f213aab tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:05.456058 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c227fd22-52c4-49fc-a7ef-5b402f213aab tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:05.456953 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d3676e18-60c9-4622-b199-41d8ec1f62d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:05.458197 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d3676e18-60c9-4622-b199-41d8ec1f62d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:05.465007 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d3676e18-60c9-4622-b199-41d8ec1f62d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:05.465836 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d3676e18-60c9-4622-b199-41d8ec1f62d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:05.466888 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d3676e18-60c9-4622-b199-41d8ec1f62d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:05.467536 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d3676e18-60c9-4622-b199-41d8ec1f62d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:05.524571 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-c227fd22-52c4-49fc-a7ef-5b402f213aab tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:05.533469 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c227fd22-52c4-49fc-a7ef-5b402f213aab tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1276 microversion: 2.1 time: 0.114766 Nov 23 07:45:05.534680 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 152/293] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:05 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1276 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:05.539726 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d98cae70-7bd5-4cc0-b512-8e5150c88f3f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:05.540514 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d98cae70-7bd5-4cc0-b512-8e5150c88f3f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:05.547773 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d98cae70-7bd5-4cc0-b512-8e5150c88f3f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:05.548365 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d98cae70-7bd5-4cc0-b512-8e5150c88f3f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:05.549256 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d98cae70-7bd5-4cc0-b512-8e5150c88f3f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:05.549687 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d3676e18-60c9-4622-b199-41d8ec1f62d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 200 len: 38307 microversion: 2.1 time: 0.098084 Nov 23 07:45:05.550170 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d98cae70-7bd5-4cc0-b512-8e5150c88f3f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:05.556581 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 142/294] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:45:05 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 38307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:45:05.562578 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-414f3f27-80e0-4ad2-9fcc-ff2e39202f39 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:05.563911 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-414f3f27-80e0-4ad2-9fcc-ff2e39202f39 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: b8fcc6a6-9265-4035-8a04-5c154de90d80] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:05.578113 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-414f3f27-80e0-4ad2-9fcc-ff2e39202f39 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:05.579543 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d98cae70-7bd5-4cc0-b512-8e5150c88f3f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/ips" status: 200 len: 150 microversion: 2.20 time: 0.042959 Nov 23 07:45:05.579915 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-414f3f27-80e0-4ad2-9fcc-ff2e39202f39 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:05.580684 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 153/295] 10.222.0.48 () {60 vars in 1288 bytes} [Tue Nov 23 07:45:05 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:45:05.581766 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-414f3f27-80e0-4ad2-9fcc-ff2e39202f39 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:05.585661 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-25ca58ed-739a-4f80-a02d-6e087c08755e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:05.586279 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-25ca58ed-739a-4f80-a02d-6e087c08755e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:05.586881 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-414f3f27-80e0-4ad2-9fcc-ff2e39202f39 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:05.593480 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-25ca58ed-739a-4f80-a02d-6e087c08755e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:05.594196 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-25ca58ed-739a-4f80-a02d-6e087c08755e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:05.595335 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-25ca58ed-739a-4f80-a02d-6e087c08755e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:05.595971 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-25ca58ed-739a-4f80-a02d-6e087c08755e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:05.635121 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-25ca58ed-739a-4f80-a02d-6e087c08755e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/ips" status: 200 len: 146 microversion: 2.1 time: 0.053173 Nov 23 07:45:05.636672 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 154/296] 10.222.0.48 () {58 vars in 1247 bytes} [Tue Nov 23 07:45:05 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/ips => generated 146 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:45:06.081173 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-f7fe69d7-aa0b-4296-83eb-403c5a93e8a6 req-bd53acbd-161b-49f0-afc0-2d4281813d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fcc6a6-9265-4035-8a04-5c154de90d80", "name": "network-vif-plugged", "status": "completed", "tag": "08e13f9c-b230-4488-b77a-25b20c843475"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:06.084220 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:45:06.084220 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:45:06.089800 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-414f3f27-80e0-4ad2-9fcc-ff2e39202f39 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:06.096699 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-f7fe69d7-aa0b-4296-83eb-403c5a93e8a6 req-bd53acbd-161b-49f0-afc0-2d4281813d3b service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:06.097276 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-414f3f27-80e0-4ad2-9fcc-ff2e39202f39 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80" status: 200 len: 1314 microversion: 2.1 time: 0.539417 Nov 23 07:45:06.097668 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-f7fe69d7-aa0b-4296-83eb-403c5a93e8a6 req-bd53acbd-161b-49f0-afc0-2d4281813d3b service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:06.102445 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 143/297] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:05 2021] GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80 => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:06.119393 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-f7fe69d7-aa0b-4296-83eb-403c5a93e8a6 req-bd53acbd-161b-49f0-afc0-2d4281813d3b service nova] Creating event network-vif-plugged:08e13f9c-b230-4488-b77a-25b20c843475 for instance b8fcc6a6-9265-4035-8a04-5c154de90d80 on hv-cinder-80403 Nov 23 07:45:06.129835 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-f7fe69d7-aa0b-4296-83eb-403c5a93e8a6 req-bd53acbd-161b-49f0-afc0-2d4281813d3b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066935 Nov 23 07:45:06.130893 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 155/298] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:45:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:45:06.292150 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f0cf99e2-6b07-4ad2-a272-d5be062b8b37 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:06.298805 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f0cf99e2-6b07-4ad2-a272-d5be062b8b37 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:06.308330 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f0cf99e2-6b07-4ad2-a272-d5be062b8b37 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:06.309195 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f0cf99e2-6b07-4ad2-a272-d5be062b8b37 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:06.310228 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f0cf99e2-6b07-4ad2-a272-d5be062b8b37 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:06.310921 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f0cf99e2-6b07-4ad2-a272-d5be062b8b37 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:06.470230 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-524765d0-3a1a-473a-9e2c-a5764be1cee4 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:06.471855 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-524765d0-3a1a-473a-9e2c-a5764be1cee4 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:06.486115 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-524765d0-3a1a-473a-9e2c-a5764be1cee4 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:06.489026 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-524765d0-3a1a-473a-9e2c-a5764be1cee4 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:06.491687 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-524765d0-3a1a-473a-9e2c-a5764be1cee4 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:06.492469 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-524765d0-3a1a-473a-9e2c-a5764be1cee4 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:06.644227 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f0cf99e2-6b07-4ad2-a272-d5be062b8b37 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:06.654181 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f0cf99e2-6b07-4ad2-a272-d5be062b8b37 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1522 microversion: 2.1 time: 0.365891 Nov 23 07:45:06.658295 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 144/299] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:06 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:06.670860 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-eb704c31-4a43-4aba-befc-f745e35663b7 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:06.671510 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-eb704c31-4a43-4aba-befc-f745e35663b7 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:06.693584 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-eb704c31-4a43-4aba-befc-f745e35663b7 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:06.695534 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-eb704c31-4a43-4aba-befc-f745e35663b7 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:06.699505 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-eb704c31-4a43-4aba-befc-f745e35663b7 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:06.700001 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-eb704c31-4a43-4aba-befc-f745e35663b7 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:06.845583 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-524765d0-3a1a-473a-9e2c-a5764be1cee4 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc02ee9bb049108541e15d65a80aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723e5a0d62d44a78bc5e939f77759f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:06.861863 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-524765d0-3a1a-473a-9e2c-a5764be1cee4 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 200 len: 1314 microversion: 2.1 time: 0.397503 Nov 23 07:45:06.867922 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 156/300] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:06 2021] GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:07.039212 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-eb704c31-4a43-4aba-befc-f745e35663b7 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:07.048197 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-eb704c31-4a43-4aba-befc-f745e35663b7 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1318 microversion: 2.1 time: 0.388581 Nov 23 07:45:07.066571 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 145/301] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:06 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:07.121093 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-06229335-3db3-4bf3-9429-e2c120d55660 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:07.122011 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-06229335-3db3-4bf3-9429-e2c120d55660 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: b8fcc6a6-9265-4035-8a04-5c154de90d80] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:07.143407 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-06229335-3db3-4bf3-9429-e2c120d55660 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:07.144223 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-06229335-3db3-4bf3-9429-e2c120d55660 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:07.145254 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-06229335-3db3-4bf3-9429-e2c120d55660 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:07.145953 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-06229335-3db3-4bf3-9429-e2c120d55660 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:07.377243 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-06229335-3db3-4bf3-9429-e2c120d55660 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:07.385835 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-06229335-3db3-4bf3-9429-e2c120d55660 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80" status: 200 len: 1314 microversion: 2.1 time: 0.269440 Nov 23 07:45:07.387361 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 157/302] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:07 2021] GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:07.674628 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-cd2d4cc5-9663-494a-b111-d34ad10e87ae tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:07.675898 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-cd2d4cc5-9663-494a-b111-d34ad10e87ae tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:07.682288 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cd2d4cc5-9663-494a-b111-d34ad10e87ae tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:07.682734 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cd2d4cc5-9663-494a-b111-d34ad10e87ae tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:07.683692 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cd2d4cc5-9663-494a-b111-d34ad10e87ae tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:07.683946 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cd2d4cc5-9663-494a-b111-d34ad10e87ae tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:07.884015 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b4f9c85b-a055-4ec1-ac17-f8cdb04125a9 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:07.884734 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-b4f9c85b-a055-4ec1-ac17-f8cdb04125a9 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:07.894648 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b4f9c85b-a055-4ec1-ac17-f8cdb04125a9 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:07.898638 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b4f9c85b-a055-4ec1-ac17-f8cdb04125a9 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:07.899586 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b4f9c85b-a055-4ec1-ac17-f8cdb04125a9 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:07.900039 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b4f9c85b-a055-4ec1-ac17-f8cdb04125a9 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:08.095036 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-cd2d4cc5-9663-494a-b111-d34ad10e87ae tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:08.124076 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-cd2d4cc5-9663-494a-b111-d34ad10e87ae tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1522 microversion: 2.1 time: 0.451776 Nov 23 07:45:08.129446 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 146/303] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:07 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:08.145240 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-96c917f8-547a-422f-8f44-5de7c70f600b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:08.146094 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-96c917f8-547a-422f-8f44-5de7c70f600b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:08.161943 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-96c917f8-547a-422f-8f44-5de7c70f600b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:08.162691 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-96c917f8-547a-422f-8f44-5de7c70f600b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:08.165062 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-96c917f8-547a-422f-8f44-5de7c70f600b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:08.167163 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-96c917f8-547a-422f-8f44-5de7c70f600b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:08.207405 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b4f9c85b-a055-4ec1-ac17-f8cdb04125a9 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc02ee9bb049108541e15d65a80aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723e5a0d62d44a78bc5e939f77759f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:08.217869 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b4f9c85b-a055-4ec1-ac17-f8cdb04125a9 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 200 len: 1314 microversion: 2.1 time: 0.337430 Nov 23 07:45:08.224124 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.objects.instance [None req-96c917f8-547a-422f-8f44-5de7c70f600b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lazy-loading 'flavor' on Instance uuid bb841a35-6344-43a0-85d2-6de8116759b1 {{(pid=122785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:45:08.239113 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 158/304] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:07 2021] GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:08.258271 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ae75a181-96d8-4aab-9ff8-0c562aece941 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:08.259298 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ae75a181-96d8-4aab-9ff8-0c562aece941 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:08.273027 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ae75a181-96d8-4aab-9ff8-0c562aece941 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:08.274131 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ae75a181-96d8-4aab-9ff8-0c562aece941 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:08.279155 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ae75a181-96d8-4aab-9ff8-0c562aece941 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:08.280023 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ae75a181-96d8-4aab-9ff8-0c562aece941 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:08.590816 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ae75a181-96d8-4aab-9ff8-0c562aece941 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:08.601833 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ae75a181-96d8-4aab-9ff8-0c562aece941 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1318 microversion: 2.1 time: 0.361282 Nov 23 07:45:08.613902 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 159/305] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:08 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:08.623747 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-64fcd6e9-7da4-4b42-9373-09e3e6cb00e8 req-c389bd29-f99b-4990-aedc-34d252d1c451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257f9b12-bb8a-4024-98e9-1b4372267afb", "name": "network-vif-plugged", "status": "completed", "tag": "cae966e3-c326-4a3a-8326-de8bd1225127"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:08.626863 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:45:08.626863 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:45:08.634421 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-64fcd6e9-7da4-4b42-9373-09e3e6cb00e8 req-c389bd29-f99b-4990-aedc-34d252d1c451 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:08.635175 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-64fcd6e9-7da4-4b42-9373-09e3e6cb00e8 req-c389bd29-f99b-4990-aedc-34d252d1c451 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:08.648997 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-64fcd6e9-7da4-4b42-9373-09e3e6cb00e8 req-c389bd29-f99b-4990-aedc-34d252d1c451 service nova] Creating event network-vif-plugged:cae966e3-c326-4a3a-8326-de8bd1225127 for instance 257f9b12-bb8a-4024-98e9-1b4372267afb on hv-cinder-80403 Nov 23 07:45:08.667705 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-64fcd6e9-7da4-4b42-9373-09e3e6cb00e8 req-c389bd29-f99b-4990-aedc-34d252d1c451 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051868 Nov 23 07:45:08.669094 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 160/306] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:45:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:45:08.676163 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-96fcdbd3-edf5-4ad4-993d-6d9dbfbfafe3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b85172fa-e98d-4668-9f66-dcb4b0737d81"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:08.690429 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-96fcdbd3-edf5-4ad4-993d-6d9dbfbfafe3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:08.710317 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-96fcdbd3-edf5-4ad4-993d-6d9dbfbfafe3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:08.711049 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-96fcdbd3-edf5-4ad4-993d-6d9dbfbfafe3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:08.712013 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-96fcdbd3-edf5-4ad4-993d-6d9dbfbfafe3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:08.712600 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-96fcdbd3-edf5-4ad4-993d-6d9dbfbfafe3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:08.970294 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-96c917f8-547a-422f-8f44-5de7c70f600b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 202 len: 0 microversion: 2.20 time: 0.839165 Nov 23 07:45:08.971582 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 147/307] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:45:08 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 0 bytes in 841 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 07:45:08.979814 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-08ad48e5-d301-4260-9639-7eec69eb9d1a req-4b11d7c7-c817-4648-ad42-21bcbfa45d60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "732e1298-1293-4cb3-833a-264392fb9ddf", "tag": "b729e24f-17fa-4c4d-a210-3cb40b8aa4a8"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:08.984195 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:45:08.984195 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:45:09.002304 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-08ad48e5-d301-4260-9639-7eec69eb9d1a req-4b11d7c7-c817-4648-ad42-21bcbfa45d60 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:09.014476 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-08ad48e5-d301-4260-9639-7eec69eb9d1a req-4b11d7c7-c817-4648-ad42-21bcbfa45d60 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:09.046682 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-08ad48e5-d301-4260-9639-7eec69eb9d1a req-4b11d7c7-c817-4648-ad42-21bcbfa45d60 service nova] Creating event network-changed:b729e24f-17fa-4c4d-a210-3cb40b8aa4a8 for instance 732e1298-1293-4cb3-833a-264392fb9ddf on hv-cinder-80403 Nov 23 07:45:09.060006 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-08ad48e5-d301-4260-9639-7eec69eb9d1a req-4b11d7c7-c817-4648-ad42-21bcbfa45d60 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086860 Nov 23 07:45:09.060615 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 148/308] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:45:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:45:09.076314 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-547d66ac-6ec8-43c3-aa83-bf6389fd8f1b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:09.077315 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-547d66ac-6ec8-43c3-aa83-bf6389fd8f1b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: b8fcc6a6-9265-4035-8a04-5c154de90d80] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:09.093020 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-547d66ac-6ec8-43c3-aa83-bf6389fd8f1b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:09.093729 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-547d66ac-6ec8-43c3-aa83-bf6389fd8f1b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:09.094724 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-547d66ac-6ec8-43c3-aa83-bf6389fd8f1b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:09.098632 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-547d66ac-6ec8-43c3-aa83-bf6389fd8f1b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:09.279943 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-96fcdbd3-edf5-4ad4-993d-6d9dbfbfafe3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.609219 Nov 23 07:45:09.302798 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 161/309] 10.222.0.48 () {60 vars in 1322 bytes} [Tue Nov 23 07:45:08 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/os-volume_attachments => generated 194 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:45:09.320257 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d57bd06c-0418-4785-8079-ac3f72520007 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:09.320969 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d57bd06c-0418-4785-8079-ac3f72520007 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:09.335333 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d57bd06c-0418-4785-8079-ac3f72520007 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:09.335820 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d57bd06c-0418-4785-8079-ac3f72520007 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:09.336641 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d57bd06c-0418-4785-8079-ac3f72520007 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:09.337084 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d57bd06c-0418-4785-8079-ac3f72520007 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:09.680343 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d57bd06c-0418-4785-8079-ac3f72520007 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:09.705637 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d57bd06c-0418-4785-8079-ac3f72520007 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:09.709282 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d57bd06c-0418-4785-8079-ac3f72520007 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:09.716536 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d57bd06c-0418-4785-8079-ac3f72520007 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.410582 Nov 23 07:45:09.717509 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 162/310] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:09 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:09.727211 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-789a0a1b-5975-436c-bfa7-c8e4bcd53748 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:09.729331 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-789a0a1b-5975-436c-bfa7-c8e4bcd53748 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:09.739427 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-789a0a1b-5975-436c-bfa7-c8e4bcd53748 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:09.740173 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-789a0a1b-5975-436c-bfa7-c8e4bcd53748 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:09.741141 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-789a0a1b-5975-436c-bfa7-c8e4bcd53748 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:09.741767 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-789a0a1b-5975-436c-bfa7-c8e4bcd53748 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:09.774896 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-547d66ac-6ec8-43c3-aa83-bf6389fd8f1b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:09.790275 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-547d66ac-6ec8-43c3-aa83-bf6389fd8f1b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80" status: 200 len: 1499 microversion: 2.1 time: 0.724739 Nov 23 07:45:09.793537 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 149/311] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:09 2021] GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80 => generated 1499 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:09.800286 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-de91091f-c67e-44f2-a929-d55be8ec0728 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:09.801145 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-de91091f-c67e-44f2-a929-d55be8ec0728 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:09.812099 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-de91091f-c67e-44f2-a929-d55be8ec0728 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:09.812754 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-de91091f-c67e-44f2-a929-d55be8ec0728 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:09.814301 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-de91091f-c67e-44f2-a929-d55be8ec0728 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:09.817330 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-de91091f-c67e-44f2-a929-d55be8ec0728 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:09.908845 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-789a0a1b-5975-436c-bfa7-c8e4bcd53748 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:09.918338 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-789a0a1b-5975-436c-bfa7-c8e4bcd53748 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1502 microversion: 2.1 time: 0.198236 Nov 23 07:45:09.920626 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 163/312] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:09 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1502 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:09.925999 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-60421c23-5060-4068-bd91-406fffae4a89 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:09.926797 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-60421c23-5060-4068-bd91-406fffae4a89 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:09.933858 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-60421c23-5060-4068-bd91-406fffae4a89 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:09.934563 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-60421c23-5060-4068-bd91-406fffae4a89 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:09.935533 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-60421c23-5060-4068-bd91-406fffae4a89 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:09.937073 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-60421c23-5060-4068-bd91-406fffae4a89 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:10.046413 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-de91091f-c67e-44f2-a929-d55be8ec0728 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc02ee9bb049108541e15d65a80aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723e5a0d62d44a78bc5e939f77759f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:10.054843 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-de91091f-c67e-44f2-a929-d55be8ec0728 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 200 len: 1314 microversion: 2.1 time: 0.260018 Nov 23 07:45:10.058253 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 150/313] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:09 2021] GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:10.069077 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-e1cfa962-5922-42a3-8098-cf1d9a6d6b67 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "326d8cfa-c1d1-4eaf-9747-1ff118792ee0"}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:10.070290 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-e1cfa962-5922-42a3-8098-cf1d9a6d6b67 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:10.077516 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e1cfa962-5922-42a3-8098-cf1d9a6d6b67 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:10.080972 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e1cfa962-5922-42a3-8098-cf1d9a6d6b67 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:10.081238 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e1cfa962-5922-42a3-8098-cf1d9a6d6b67 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:10.081694 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e1cfa962-5922-42a3-8098-cf1d9a6d6b67 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:10.129087 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-e1cfa962-5922-42a3-8098-cf1d9a6d6b67 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] HTTP exception thrown: Cannot 'attach_volume' instance c5cba5f7-c9fd-4708-923c-deec6ab27cdd while it is in vm_state rescued Nov 23 07:45:10.133056 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-e1cfa962-5922-42a3-8098-cf1d9a6d6b67 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Returning 409 to user: Cannot 'attach_volume' instance c5cba5f7-c9fd-4708-923c-deec6ab27cdd while it is in vm_state rescued {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:45:10.139695 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-e1cfa962-5922-42a3-8098-cf1d9a6d6b67 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "POST /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.074380 Nov 23 07:45:10.140984 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 151/314] 10.222.0.48 () {60 vars in 1322 bytes} [Tue Nov 23 07:45:10 2021] POST /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/os-volume_attachments => generated 152 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 23 07:45:10.151492 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-41b6177d-09c3-40ea-895d-72314e6893de tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:10.153068 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-41b6177d-09c3-40ea-895d-72314e6893de tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:10.165377 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-41b6177d-09c3-40ea-895d-72314e6893de tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:10.165377 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-41b6177d-09c3-40ea-895d-72314e6893de tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:10.166352 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-41b6177d-09c3-40ea-895d-72314e6893de tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:10.166809 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-41b6177d-09c3-40ea-895d-72314e6893de tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:10.328490 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-41b6177d-09c3-40ea-895d-72314e6893de tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "POST /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/action" status: 202 len: 0 microversion: 2.1 time: 0.181795 Nov 23 07:45:10.336257 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 152/315] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:45:10 2021] POST /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:45:10.343901 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-2e1edd1d-3d87-4b39-8008-03cf6d6d0439 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:10.345058 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-2e1edd1d-3d87-4b39-8008-03cf6d6d0439 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:10.354529 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2e1edd1d-3d87-4b39-8008-03cf6d6d0439 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:10.355416 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2e1edd1d-3d87-4b39-8008-03cf6d6d0439 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:10.358805 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2e1edd1d-3d87-4b39-8008-03cf6d6d0439 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:10.360566 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2e1edd1d-3d87-4b39-8008-03cf6d6d0439 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:10.373446 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-60421c23-5060-4068-bd91-406fffae4a89 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:10.384300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-60421c23-5060-4068-bd91-406fffae4a89 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1318 microversion: 2.1 time: 0.462315 Nov 23 07:45:10.393987 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 164/316] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:09 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:10.576832 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-cd3c1165-4794-4928-8215-82eaa88dc784 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:10.577514 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-cd3c1165-4794-4928-8215-82eaa88dc784 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: b8fcc6a6-9265-4035-8a04-5c154de90d80] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:10.584398 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cd3c1165-4794-4928-8215-82eaa88dc784 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:10.588486 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cd3c1165-4794-4928-8215-82eaa88dc784 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:10.590475 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cd3c1165-4794-4928-8215-82eaa88dc784 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:10.591088 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cd3c1165-4794-4928-8215-82eaa88dc784 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:10.638659 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-cd3c1165-4794-4928-8215-82eaa88dc784 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: b8fcc6a6-9265-4035-8a04-5c154de90d80] Going to try to terminate instance {{(pid=122786) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:45:10.787332 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-cd3c1165-4794-4928-8215-82eaa88dc784 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80" status: 204 len: 0 microversion: 2.1 time: 0.214698 Nov 23 07:45:10.788611 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 165/317] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:45:10 2021] DELETE /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 07:45:10.796989 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a0521a8d-4b75-48e1-8056-d459c235e0c4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:10.798123 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a0521a8d-4b75-48e1-8056-d459c235e0c4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:10.806915 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a0521a8d-4b75-48e1-8056-d459c235e0c4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:10.807696 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a0521a8d-4b75-48e1-8056-d459c235e0c4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:10.808678 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a0521a8d-4b75-48e1-8056-d459c235e0c4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:10.809332 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a0521a8d-4b75-48e1-8056-d459c235e0c4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:10.855820 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-2e1edd1d-3d87-4b39-8008-03cf6d6d0439 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:10.864788 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-2e1edd1d-3d87-4b39-8008-03cf6d6d0439 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1510 microversion: 2.1 time: 0.526024 Nov 23 07:45:10.867588 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 153/318] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:10 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1510 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:10.881077 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5f758094-e66a-4e15-9ae0-e986a3cec79d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:10.881988 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5f758094-e66a-4e15-9ae0-e986a3cec79d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: b8fcc6a6-9265-4035-8a04-5c154de90d80] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:10.894440 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5f758094-e66a-4e15-9ae0-e986a3cec79d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:10.894880 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5f758094-e66a-4e15-9ae0-e986a3cec79d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:10.898998 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5f758094-e66a-4e15-9ae0-e986a3cec79d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:10.902372 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5f758094-e66a-4e15-9ae0-e986a3cec79d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:11.027724 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a0521a8d-4b75-48e1-8056-d459c235e0c4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:11.050990 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a0521a8d-4b75-48e1-8056-d459c235e0c4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:11.052974 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a0521a8d-4b75-48e1-8056-d459c235e0c4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:11.057490 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a0521a8d-4b75-48e1-8056-d459c235e0c4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.267007 Nov 23 07:45:11.060312 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 166/319] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:10 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:11.076825 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-5c543201-9fc6-45aa-b5f6-6607fd3a297c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:11.076825 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-5c543201-9fc6-45aa-b5f6-6607fd3a297c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:11.084878 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5c543201-9fc6-45aa-b5f6-6607fd3a297c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:11.085636 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5c543201-9fc6-45aa-b5f6-6607fd3a297c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:11.086625 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5c543201-9fc6-45aa-b5f6-6607fd3a297c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:11.087305 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5c543201-9fc6-45aa-b5f6-6607fd3a297c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:11.317878 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5c543201-9fc6-45aa-b5f6-6607fd3a297c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc02ee9bb049108541e15d65a80aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723e5a0d62d44a78bc5e939f77759f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:11.327056 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-5c543201-9fc6-45aa-b5f6-6607fd3a297c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 200 len: 1314 microversion: 2.1 time: 0.256891 Nov 23 07:45:11.327860 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 167/320] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:11 2021] GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:11.369903 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5f758094-e66a-4e15-9ae0-e986a3cec79d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:11.382015 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5f758094-e66a-4e15-9ae0-e986a3cec79d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80" status: 200 len: 1505 microversion: 2.1 time: 0.511834 Nov 23 07:45:11.382610 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 154/321] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:10 2021] GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80 => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:11.407351 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-054bf23c-8e21-4ce1-a749-48a7c1a7c1b3 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:11.408336 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-054bf23c-8e21-4ce1-a749-48a7c1a7c1b3 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:11.420443 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-054bf23c-8e21-4ce1-a749-48a7c1a7c1b3 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:11.424923 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-054bf23c-8e21-4ce1-a749-48a7c1a7c1b3 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:11.426303 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-054bf23c-8e21-4ce1-a749-48a7c1a7c1b3 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:11.426981 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-054bf23c-8e21-4ce1-a749-48a7c1a7c1b3 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:11.596964 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-054bf23c-8e21-4ce1-a749-48a7c1a7c1b3 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:11.606174 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-054bf23c-8e21-4ce1-a749-48a7c1a7c1b3 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1318 microversion: 2.1 time: 0.202417 Nov 23 07:45:11.607203 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 168/322] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:11 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:11.886604 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-a1ef96ef-01d4-4dba-8fc5-b297210b1efc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:11.887448 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-a1ef96ef-01d4-4dba-8fc5-b297210b1efc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:11.894601 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a1ef96ef-01d4-4dba-8fc5-b297210b1efc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:11.895266 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a1ef96ef-01d4-4dba-8fc5-b297210b1efc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:11.896272 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a1ef96ef-01d4-4dba-8fc5-b297210b1efc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:11.896904 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a1ef96ef-01d4-4dba-8fc5-b297210b1efc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:12.077651 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a1ef96ef-01d4-4dba-8fc5-b297210b1efc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:12.080005 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-f5454366-addb-4785-9571-4fd1aac23e6e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:12.080825 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f5454366-addb-4785-9571-4fd1aac23e6e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:12.090409 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f5454366-addb-4785-9571-4fd1aac23e6e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:12.091066 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f5454366-addb-4785-9571-4fd1aac23e6e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:12.092059 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f5454366-addb-4785-9571-4fd1aac23e6e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:12.092652 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f5454366-addb-4785-9571-4fd1aac23e6e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:12.104549 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-a1ef96ef-01d4-4dba-8fc5-b297210b1efc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1510 microversion: 2.1 time: 0.223303 Nov 23 07:45:12.106280 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 155/323] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:11 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:12.297137 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-f5454366-addb-4785-9571-4fd1aac23e6e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:12.308476 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-f5454366-addb-4785-9571-4fd1aac23e6e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:12.311992 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-f5454366-addb-4785-9571-4fd1aac23e6e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:12.311992 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-f5454366-addb-4785-9571-4fd1aac23e6e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.236295 Nov 23 07:45:12.311992 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 169/324] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:12 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:12.343665 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-74b56113-052c-404b-98b7-c16666626653 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:12.344271 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-74b56113-052c-404b-98b7-c16666626653 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:12.350883 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-74b56113-052c-404b-98b7-c16666626653 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:12.351325 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-74b56113-052c-404b-98b7-c16666626653 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:12.352098 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-74b56113-052c-404b-98b7-c16666626653 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:12.352524 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-74b56113-052c-404b-98b7-c16666626653 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:12.399063 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1d711bf3-0235-4f71-898b-6ffe078967db tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:12.400013 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1d711bf3-0235-4f71-898b-6ffe078967db tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: b8fcc6a6-9265-4035-8a04-5c154de90d80] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:12.414114 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1d711bf3-0235-4f71-898b-6ffe078967db tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:12.415210 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1d711bf3-0235-4f71-898b-6ffe078967db tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:12.418893 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1d711bf3-0235-4f71-898b-6ffe078967db tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:12.419462 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1d711bf3-0235-4f71-898b-6ffe078967db tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:12.556922 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-74b56113-052c-404b-98b7-c16666626653 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc02ee9bb049108541e15d65a80aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723e5a0d62d44a78bc5e939f77759f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:12.568165 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-74b56113-052c-404b-98b7-c16666626653 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 200 len: 1464 microversion: 2.1 time: 0.228009 Nov 23 07:45:12.576945 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 156/325] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:12 2021] GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 1464 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:12.622940 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-7572e3d1-681d-4f9e-aa0f-677a7af128fc tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:12.622940 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-7572e3d1-681d-4f9e-aa0f-677a7af128fc tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:12.626568 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1d711bf3-0235-4f71-898b-6ffe078967db tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:12.629807 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7572e3d1-681d-4f9e-aa0f-677a7af128fc tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:12.630386 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7572e3d1-681d-4f9e-aa0f-677a7af128fc tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:12.631295 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7572e3d1-681d-4f9e-aa0f-677a7af128fc tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:12.631850 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7572e3d1-681d-4f9e-aa0f-677a7af128fc tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:12.638513 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1d711bf3-0235-4f71-898b-6ffe078967db tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80" status: 200 len: 1505 microversion: 2.1 time: 0.242567 Nov 23 07:45:12.640018 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 170/326] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:12 2021] GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80 => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:12.645913 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-3b29dbb2-3255-47f6-9931-a940c047670f tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:12.648465 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-3b29dbb2-3255-47f6-9931-a940c047670f tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:12.658314 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3b29dbb2-3255-47f6-9931-a940c047670f tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:12.658767 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3b29dbb2-3255-47f6-9931-a940c047670f tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:12.659581 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3b29dbb2-3255-47f6-9931-a940c047670f tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:12.660022 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3b29dbb2-3255-47f6-9931-a940c047670f tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:12.675150 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-7572e3d1-681d-4f9e-aa0f-677a7af128fc tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Going to try to terminate instance {{(pid=122785) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:45:12.846904 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-7572e3d1-681d-4f9e-aa0f-677a7af128fc tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "DELETE /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 204 len: 0 microversion: 2.1 time: 0.227951 Nov 23 07:45:12.847250 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 157/327] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:45:12 2021] DELETE /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 07:45:12.858414 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-3b29dbb2-3255-47f6-9931-a940c047670f tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:12.866127 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-3b29dbb2-3255-47f6-9931-a940c047670f tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1318 microversion: 2.1 time: 0.225016 Nov 23 07:45:12.866899 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 171/328] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:12 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:12.867840 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-950d9878-c9f4-43f7-89bc-1adf224e1c42 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:12.868847 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-950d9878-c9f4-43f7-89bc-1adf224e1c42 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:12.877361 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-950d9878-c9f4-43f7-89bc-1adf224e1c42 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:12.877875 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-950d9878-c9f4-43f7-89bc-1adf224e1c42 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:12.878857 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-950d9878-c9f4-43f7-89bc-1adf224e1c42 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:12.879097 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-950d9878-c9f4-43f7-89bc-1adf224e1c42 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:13.127137 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b4b35671-abcf-465a-bec6-6972f7490a0b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:13.127648 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-b4b35671-abcf-465a-bec6-6972f7490a0b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:13.133894 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-950d9878-c9f4-43f7-89bc-1adf224e1c42 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc02ee9bb049108541e15d65a80aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723e5a0d62d44a78bc5e939f77759f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:13.134046 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b4b35671-abcf-465a-bec6-6972f7490a0b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:13.134403 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b4b35671-abcf-465a-bec6-6972f7490a0b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:13.135205 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b4b35671-abcf-465a-bec6-6972f7490a0b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:13.135637 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b4b35671-abcf-465a-bec6-6972f7490a0b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:13.143313 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-950d9878-c9f4-43f7-89bc-1adf224e1c42 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 200 len: 1470 microversion: 2.1 time: 0.289178 Nov 23 07:45:13.143903 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 158/329] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:12 2021] GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 1470 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:13.319714 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b4b35671-abcf-465a-bec6-6972f7490a0b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:13.335006 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-720b9cc4-ccc9-4fa0-8682-81659cb621f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:13.335949 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-720b9cc4-ccc9-4fa0-8682-81659cb621f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:13.346844 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b4b35671-abcf-465a-bec6-6972f7490a0b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1510 microversion: 2.1 time: 0.223311 Nov 23 07:45:13.351082 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-720b9cc4-ccc9-4fa0-8682-81659cb621f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:13.351842 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-720b9cc4-ccc9-4fa0-8682-81659cb621f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:13.352854 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 172/330] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:13 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1510 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:13.355022 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-720b9cc4-ccc9-4fa0-8682-81659cb621f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:13.356223 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-720b9cc4-ccc9-4fa0-8682-81659cb621f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:13.393447 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-5eddb69e-0a9f-4f43-837c-6568c1b2f4ac req-abc4df46-4ab0-4631-9d3f-9cd6f084ad9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fcc6a6-9265-4035-8a04-5c154de90d80", "name": "network-vif-deleted", "tag": "08e13f9c-b230-4488-b77a-25b20c843475"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:13.395469 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:45:13.395469 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:45:13.404837 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-5eddb69e-0a9f-4f43-837c-6568c1b2f4ac req-abc4df46-4ab0-4631-9d3f-9cd6f084ad9b service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:13.405996 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-5eddb69e-0a9f-4f43-837c-6568c1b2f4ac req-abc4df46-4ab0-4631-9d3f-9cd6f084ad9b service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:13.431871 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-5eddb69e-0a9f-4f43-837c-6568c1b2f4ac req-abc4df46-4ab0-4631-9d3f-9cd6f084ad9b service nova] Creating event network-vif-deleted:08e13f9c-b230-4488-b77a-25b20c843475 for instance b8fcc6a6-9265-4035-8a04-5c154de90d80 on hv-cinder-80403 Nov 23 07:45:13.441957 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-5eddb69e-0a9f-4f43-837c-6568c1b2f4ac req-abc4df46-4ab0-4631-9d3f-9cd6f084ad9b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051870 Nov 23 07:45:13.443083 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 173/331] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:45:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:45:13.534769 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-720b9cc4-ccc9-4fa0-8682-81659cb621f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:13.549740 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-720b9cc4-ccc9-4fa0-8682-81659cb621f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:13.560150 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-720b9cc4-ccc9-4fa0-8682-81659cb621f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:13.561473 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-720b9cc4-ccc9-4fa0-8682-81659cb621f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.231439 Nov 23 07:45:13.570877 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 159/332] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:13 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:45:13.655903 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-f53482a5-9ebf-4157-8e25-fb53629eefaa tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:13.656507 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f53482a5-9ebf-4157-8e25-fb53629eefaa tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: b8fcc6a6-9265-4035-8a04-5c154de90d80] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:13.662669 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f53482a5-9ebf-4157-8e25-fb53629eefaa tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:13.663113 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f53482a5-9ebf-4157-8e25-fb53629eefaa tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:13.663882 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f53482a5-9ebf-4157-8e25-fb53629eefaa tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:13.664571 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f53482a5-9ebf-4157-8e25-fb53629eefaa tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:13.699201 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f53482a5-9ebf-4157-8e25-fb53629eefaa tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:13.699631 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f53482a5-9ebf-4157-8e25-fb53629eefaa tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:13.700084 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.objects.instance [None req-f53482a5-9ebf-4157-8e25-fb53629eefaa tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lazy-loading 'fault' on Instance uuid b8fcc6a6-9265-4035-8a04-5c154de90d80 {{(pid=122786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:45:13.750345 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-f53482a5-9ebf-4157-8e25-fb53629eefaa tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:13.758067 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-f53482a5-9ebf-4157-8e25-fb53629eefaa tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80" status: 200 len: 1304 microversion: 2.1 time: 0.106125 Nov 23 07:45:13.760952 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 174/333] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:13 2021] GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:13.882495 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-0bea6e8d-d75b-4ab4-9759-3d8480568edd tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:13.883467 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-0bea6e8d-d75b-4ab4-9759-3d8480568edd tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:13.891223 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0bea6e8d-d75b-4ab4-9759-3d8480568edd tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:13.891960 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0bea6e8d-d75b-4ab4-9759-3d8480568edd tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:13.893061 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0bea6e8d-d75b-4ab4-9759-3d8480568edd tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:13.893791 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0bea6e8d-d75b-4ab4-9759-3d8480568edd tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:14.091240 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0bea6e8d-d75b-4ab4-9759-3d8480568edd tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:14.101208 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-0bea6e8d-d75b-4ab4-9759-3d8480568edd tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1318 microversion: 2.1 time: 0.222508 Nov 23 07:45:14.102297 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 160/334] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:13 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:14.136940 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-23237bbe-ecbf-45c9-873b-384f11196ef2 req-8e299e3e-9d8e-4fac-99d6-d3f50ad19a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "732e1298-1293-4cb3-833a-264392fb9ddf", "name": "network-vif-plugged", "status": "completed", "tag": "b729e24f-17fa-4c4d-a210-3cb40b8aa4a8"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:14.141953 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:45:14.141953 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:45:14.160110 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-a75a9c7d-7ec8-44d5-a7f6-1c43613819ff tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:14.160714 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-a75a9c7d-7ec8-44d5-a7f6-1c43613819ff tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:14.168623 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-23237bbe-ecbf-45c9-873b-384f11196ef2 req-8e299e3e-9d8e-4fac-99d6-d3f50ad19a15 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:14.170062 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-23237bbe-ecbf-45c9-873b-384f11196ef2 req-8e299e3e-9d8e-4fac-99d6-d3f50ad19a15 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:14.171551 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a75a9c7d-7ec8-44d5-a7f6-1c43613819ff tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:14.172125 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a75a9c7d-7ec8-44d5-a7f6-1c43613819ff tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:14.173219 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a75a9c7d-7ec8-44d5-a7f6-1c43613819ff tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:14.173666 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a75a9c7d-7ec8-44d5-a7f6-1c43613819ff tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:14.215746 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-23237bbe-ecbf-45c9-873b-384f11196ef2 req-8e299e3e-9d8e-4fac-99d6-d3f50ad19a15 service nova] Creating event network-vif-plugged:b729e24f-17fa-4c4d-a210-3cb40b8aa4a8 for instance 732e1298-1293-4cb3-833a-264392fb9ddf on hv-cinder-80403 Nov 23 07:45:14.234864 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-23237bbe-ecbf-45c9-873b-384f11196ef2 req-8e299e3e-9d8e-4fac-99d6-d3f50ad19a15 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102195 Nov 23 07:45:14.236098 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 175/335] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:45:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:45:14.371029 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c0c74098-f3d0-4d4b-a36b-5b0f6071529f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:14.372124 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c0c74098-f3d0-4d4b-a36b-5b0f6071529f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:14.379491 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c0c74098-f3d0-4d4b-a36b-5b0f6071529f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:14.379943 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c0c74098-f3d0-4d4b-a36b-5b0f6071529f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:14.382114 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c0c74098-f3d0-4d4b-a36b-5b0f6071529f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:14.382709 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c0c74098-f3d0-4d4b-a36b-5b0f6071529f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:14.567898 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-c0c74098-f3d0-4d4b-a36b-5b0f6071529f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:14.579342 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c0c74098-f3d0-4d4b-a36b-5b0f6071529f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1516 microversion: 2.1 time: 0.212617 Nov 23 07:45:14.589774 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 176/336] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:14 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1516 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:14.589774 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-424d23d3-d5ac-4177-9148-135f33f807ed tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:14.589774 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-424d23d3-d5ac-4177-9148-135f33f807ed tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:14.596357 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-424d23d3-d5ac-4177-9148-135f33f807ed tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:14.598654 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-424d23d3-d5ac-4177-9148-135f33f807ed tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:14.599707 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-424d23d3-d5ac-4177-9148-135f33f807ed tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:14.601904 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-424d23d3-d5ac-4177-9148-135f33f807ed tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:14.620083 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a75a9c7d-7ec8-44d5-a7f6-1c43613819ff tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc02ee9bb049108541e15d65a80aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723e5a0d62d44a78bc5e939f77759f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:14.633225 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-a75a9c7d-7ec8-44d5-a7f6-1c43613819ff tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 200 len: 1470 microversion: 2.1 time: 0.476678 Nov 23 07:45:14.644094 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 161/337] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:14 2021] GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 1470 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:14.782497 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-1635fa6d-a525-4e83-ab7e-3c85e5a5ac6c tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:14.783495 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-1635fa6d-a525-4e83-ab7e-3c85e5a5ac6c tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: b8fcc6a6-9265-4035-8a04-5c154de90d80] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:14.800530 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1635fa6d-a525-4e83-ab7e-3c85e5a5ac6c tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:14.801133 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1635fa6d-a525-4e83-ab7e-3c85e5a5ac6c tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:14.802039 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1635fa6d-a525-4e83-ab7e-3c85e5a5ac6c tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:14.802427 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1635fa6d-a525-4e83-ab7e-3c85e5a5ac6c tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:14.831173 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-1635fa6d-a525-4e83-ab7e-3c85e5a5ac6c tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] HTTP exception thrown: Instance b8fcc6a6-9265-4035-8a04-5c154de90d80 could not be found. Nov 23 07:45:14.840268 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-1635fa6d-a525-4e83-ab7e-3c85e5a5ac6c tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Returning 404 to user: Instance b8fcc6a6-9265-4035-8a04-5c154de90d80 could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:45:14.841835 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-1635fa6d-a525-4e83-ab7e-3c85e5a5ac6c tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80" status: 404 len: 111 microversion: 2.1 time: 0.065128 Nov 23 07:45:14.842818 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 162/338] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:14 2021] GET /compute/v2.1/servers/b8fcc6a6-9265-4035-8a04-5c154de90d80 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 07:45:15.022922 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5959a945-5a95-4822-a251-0a44f68807af tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1721028461", "imageRef": "6895b3b6-16b9-4e43-bf1b-c19e73615ca8", "flavorRef": "452", "networks": [{"uuid": "1d025715-d454-4776-858b-529ffc8c62df"}]}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:15.106144 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-424d23d3-d5ac-4177-9148-135f33f807ed tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:15.117588 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-424d23d3-d5ac-4177-9148-135f33f807ed tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:15.120959 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.network.neutron [None req-5959a945-5a95-4822-a251-0a44f68807af tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] validate_networks() for [('1d025715-d454-4776-858b-529ffc8c62df', None, None, None, None, None)] {{(pid=122785) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:45:15.121222 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-424d23d3-d5ac-4177-9148-135f33f807ed tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:15.122456 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-424d23d3-d5ac-4177-9148-135f33f807ed tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.540853 Nov 23 07:45:15.123023 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 177/339] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:14 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:15.133655 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-070e0045-dcde-4fef-8af2-3d242c141eeb tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:15.136606 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-070e0045-dcde-4fef-8af2-3d242c141eeb tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:15.154321 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-070e0045-dcde-4fef-8af2-3d242c141eeb tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:15.155337 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-070e0045-dcde-4fef-8af2-3d242c141eeb tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:15.156987 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-070e0045-dcde-4fef-8af2-3d242c141eeb tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:15.157903 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-070e0045-dcde-4fef-8af2-3d242c141eeb tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:15.327615 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-070e0045-dcde-4fef-8af2-3d242c141eeb tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:15.336102 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-070e0045-dcde-4fef-8af2-3d242c141eeb tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1318 microversion: 2.1 time: 0.212057 Nov 23 07:45:15.336751 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 178/340] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:15 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:15.656608 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a5154a96-a264-464d-8a9b-9a244169e499 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:15.659100 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a5154a96-a264-464d-8a9b-9a244169e499 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:15.693616 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a5154a96-a264-464d-8a9b-9a244169e499 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:15.694291 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a5154a96-a264-464d-8a9b-9a244169e499 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:15.695194 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a5154a96-a264-464d-8a9b-9a244169e499 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:15.695733 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a5154a96-a264-464d-8a9b-9a244169e499 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:15.899906 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-5959a945-5a95-4822-a251-0a44f68807af tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Flavor limits 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:45:15.900912 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-5959a945-5a95-4822-a251-0a44f68807af tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Image limits 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:45:15.901327 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-5959a945-5a95-4822-a251-0a44f68807af tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Flavor pref 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:45:15.901814 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-5959a945-5a95-4822-a251-0a44f68807af tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Image pref 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:45:15.902224 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-5959a945-5a95-4822-a251-0a44f68807af tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:45:15.917098 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5959a945-5a95-4822-a251-0a44f68807af tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:15.918364 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5959a945-5a95-4822-a251-0a44f68807af tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:15.920471 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a5154a96-a264-464d-8a9b-9a244169e499 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc02ee9bb049108541e15d65a80aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723e5a0d62d44a78bc5e939f77759f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:15.920639 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5959a945-5a95-4822-a251-0a44f68807af tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:15.920639 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5959a945-5a95-4822-a251-0a44f68807af tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:15.933997 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a5154a96-a264-464d-8a9b-9a244169e499 tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 200 len: 1470 microversion: 2.1 time: 0.282929 Nov 23 07:45:15.934570 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 179/341] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:15 2021] GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 1470 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:15.981781 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-5959a945-5a95-4822-a251-0a44f68807af tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Getting quotas for project 8c9142ed0ac74c31a3d2b005076861fb. Resources: {'instances', 'cores', 'ram'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:45:15.985437 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-5959a945-5a95-4822-a251-0a44f68807af tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Getting quotas for user f602e0688ca74408a1de8431ceb40649 and project 8c9142ed0ac74c31a3d2b005076861fb. Resources: {'instances', 'cores', 'ram'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:45:15.999203 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5959a945-5a95-4822-a251-0a44f68807af tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Going to run 1 instances... {{(pid=122785) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:45:16.006705 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5959a945-5a95-4822-a251-0a44f68807af tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6895b3b6-16b9-4e43-bf1b-c19e73615ca8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:45:16.126364 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5959a945-5a95-4822-a251-0a44f68807af tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.106697 Nov 23 07:45:16.127022 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 163/342] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Nov 23 07:45:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 07:45:16.142942 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6358e3bd-b6c8-484e-ad0a-5b648f3738a0 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:16.143590 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6358e3bd-b6c8-484e-ad0a-5b648f3738a0 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:16.164394 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-26d3a5d3-141e-4778-afe2-33865526b60e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:16.165612 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-26d3a5d3-141e-4778-afe2-33865526b60e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:16.200004 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-26d3a5d3-141e-4778-afe2-33865526b60e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:16.201654 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-26d3a5d3-141e-4778-afe2-33865526b60e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:16.203678 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-26d3a5d3-141e-4778-afe2-33865526b60e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:16.204343 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-26d3a5d3-141e-4778-afe2-33865526b60e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:16.270388 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6358e3bd-b6c8-484e-ad0a-5b648f3738a0 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:16.279925 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6358e3bd-b6c8-484e-ad0a-5b648f3738a0 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1214 microversion: 2.1 time: 0.144884 Nov 23 07:45:16.294419 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 180/343] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:16 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:16.313695 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-2d703c80-fe11-4de2-a203-673dba43f251 req-2f75f892-4367-48a6-add9-686207174eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257f9b12-bb8a-4024-98e9-1b4372267afb", "name": "network-vif-deleted", "tag": "cae966e3-c326-4a3a-8326-de8bd1225127"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:16.315764 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:45:16.315764 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:45:16.336124 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-2d703c80-fe11-4de2-a203-673dba43f251 req-2f75f892-4367-48a6-add9-686207174eb8 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:16.338487 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-2d703c80-fe11-4de2-a203-673dba43f251 req-2f75f892-4367-48a6-add9-686207174eb8 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:16.368678 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-2d703c80-fe11-4de2-a203-673dba43f251 req-2f75f892-4367-48a6-add9-686207174eb8 service nova] Creating event network-vif-deleted:cae966e3-c326-4a3a-8326-de8bd1225127 for instance 257f9b12-bb8a-4024-98e9-1b4372267afb on hv-cinder-80403 Nov 23 07:45:16.377519 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-2d703c80-fe11-4de2-a203-673dba43f251 req-2f75f892-4367-48a6-add9-686207174eb8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081506 Nov 23 07:45:16.378983 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 181/344] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:45:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:45:16.387587 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-2e28f28c-c6b6-450a-ad95-111a9442a512 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:16.388638 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-2e28f28c-c6b6-450a-ad95-111a9442a512 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:16.413339 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2e28f28c-c6b6-450a-ad95-111a9442a512 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:16.414979 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2e28f28c-c6b6-450a-ad95-111a9442a512 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:16.418616 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2e28f28c-c6b6-450a-ad95-111a9442a512 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:16.419653 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2e28f28c-c6b6-450a-ad95-111a9442a512 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:16.450197 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-26d3a5d3-141e-4778-afe2-33865526b60e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:16.464259 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-26d3a5d3-141e-4778-afe2-33865526b60e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:16.465858 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-26d3a5d3-141e-4778-afe2-33865526b60e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:16.467042 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-26d3a5d3-141e-4778-afe2-33865526b60e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.324200 Nov 23 07:45:16.467597 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 164/345] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:16 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:16.482195 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-7e4c5c75-602d-48a2-b4f4-3ef6e82a1f7d tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:16.483061 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-7e4c5c75-602d-48a2-b4f4-3ef6e82a1f7d tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:16.491846 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7e4c5c75-602d-48a2-b4f4-3ef6e82a1f7d tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:16.492530 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7e4c5c75-602d-48a2-b4f4-3ef6e82a1f7d tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:16.493506 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7e4c5c75-602d-48a2-b4f4-3ef6e82a1f7d tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:16.494177 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7e4c5c75-602d-48a2-b4f4-3ef6e82a1f7d tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:16.621247 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2e28f28c-c6b6-450a-ad95-111a9442a512 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:16.631911 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-2e28f28c-c6b6-450a-ad95-111a9442a512 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1516 microversion: 2.1 time: 0.250285 Nov 23 07:45:16.641730 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 182/346] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:16 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1516 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:16.651826 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c2150ad8-e478-4df6-927c-901171476937 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3e0bbd4-ce1e-4b68-b50e-bc909648fd36"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:16.654923 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c2150ad8-e478-4df6-927c-901171476937 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:16.662938 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c2150ad8-e478-4df6-927c-901171476937 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:16.664852 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c2150ad8-e478-4df6-927c-901171476937 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:16.665969 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c2150ad8-e478-4df6-927c-901171476937 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:16.667114 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c2150ad8-e478-4df6-927c-901171476937 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:16.684286 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-7e4c5c75-602d-48a2-b4f4-3ef6e82a1f7d tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:16.691994 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-7e4c5c75-602d-48a2-b4f4-3ef6e82a1f7d tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1506 microversion: 2.1 time: 0.216051 Nov 23 07:45:16.707234 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 165/347] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:16 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:16.952044 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-b6367f86-a8b6-42de-813a-c5c5a951b23c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:16.953267 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-b6367f86-a8b6-42de-813a-c5c5a951b23c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] [instance: 257f9b12-bb8a-4024-98e9-1b4372267afb] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:16.960758 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b6367f86-a8b6-42de-813a-c5c5a951b23c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:16.961195 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b6367f86-a8b6-42de-813a-c5c5a951b23c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:16.962003 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b6367f86-a8b6-42de-813a-c5c5a951b23c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:16.962977 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b6367f86-a8b6-42de-813a-c5c5a951b23c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:16.984927 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-b6367f86-a8b6-42de-813a-c5c5a951b23c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] HTTP exception thrown: Instance 257f9b12-bb8a-4024-98e9-1b4372267afb could not be found. Nov 23 07:45:16.989681 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-b6367f86-a8b6-42de-813a-c5c5a951b23c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] Returning 404 to user: Instance 257f9b12-bb8a-4024-98e9-1b4372267afb could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:45:16.991307 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-b6367f86-a8b6-42de-813a-c5c5a951b23c tempest-VolumesNegativeTest-19722383 tempest-VolumesNegativeTest-19722383-project] 10.222.0.48 "GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb" status: 404 len: 111 microversion: 2.1 time: 0.043827 Nov 23 07:45:16.997684 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 166/348] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:16 2021] GET /compute/v2.1/servers/257f9b12-bb8a-4024-98e9-1b4372267afb => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:45:17.143435 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c2150ad8-e478-4df6-927c-901171476937 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "POST /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.497460 Nov 23 07:45:17.146388 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 183/349] 10.222.0.48 () {60 vars in 1322 bytes} [Tue Nov 23 07:45:16 2021] POST /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/os-volume_attachments => generated 194 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:45:17.299430 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-313f2743-c7c4-4dfe-a964-7d95e33f8e82 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:17.300033 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-313f2743-c7c4-4dfe-a964-7d95e33f8e82 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:17.308404 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-313f2743-c7c4-4dfe-a964-7d95e33f8e82 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:17.308858 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-313f2743-c7c4-4dfe-a964-7d95e33f8e82 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:17.313377 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-313f2743-c7c4-4dfe-a964-7d95e33f8e82 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:17.313849 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-313f2743-c7c4-4dfe-a964-7d95e33f8e82 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:17.352716 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b50a210c-1e5a-4606-bf6f-40c11410bac8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:17.370616 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b50a210c-1e5a-4606-bf6f-40c11410bac8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:17.371075 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b50a210c-1e5a-4606-bf6f-40c11410bac8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:17.416552 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-313f2743-c7c4-4dfe-a964-7d95e33f8e82 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:17.429668 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-313f2743-c7c4-4dfe-a964-7d95e33f8e82 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1266 microversion: 2.1 time: 0.134664 Nov 23 07:45:17.440814 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 167/350] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:17 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:17.470470 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-b50a210c-1e5a-4606-bf6f-40c11410bac8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Going to try to stop instance {{(pid=122786) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 23 07:45:17.486294 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-0f31dd1b-49fc-4002-93eb-f65298c62483 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:17.487165 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-0f31dd1b-49fc-4002-93eb-f65298c62483 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:17.498586 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0f31dd1b-49fc-4002-93eb-f65298c62483 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:17.499675 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0f31dd1b-49fc-4002-93eb-f65298c62483 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:17.500557 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0f31dd1b-49fc-4002-93eb-f65298c62483 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:17.505394 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0f31dd1b-49fc-4002-93eb-f65298c62483 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:17.580431 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b50a210c-1e5a-4606-bf6f-40c11410bac8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 202 len: 0 microversion: 2.1 time: 0.233393 Nov 23 07:45:17.581504 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 184/351] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:45:17 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:45:17.597612 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-87a8e210-ef0e-4457-8fb0-457ea21b3faa tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:17.598365 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-87a8e210-ef0e-4457-8fb0-457ea21b3faa tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:17.609069 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-87a8e210-ef0e-4457-8fb0-457ea21b3faa tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:17.609566 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-87a8e210-ef0e-4457-8fb0-457ea21b3faa tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:17.610397 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-87a8e210-ef0e-4457-8fb0-457ea21b3faa tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:17.610841 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-87a8e210-ef0e-4457-8fb0-457ea21b3faa tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:17.809525 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-87a8e210-ef0e-4457-8fb0-457ea21b3faa tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:17.821456 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-87a8e210-ef0e-4457-8fb0-457ea21b3faa tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1724 microversion: 2.1 time: 0.235665 Nov 23 07:45:17.823792 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 185/352] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:17 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:18.013114 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0f31dd1b-49fc-4002-93eb-f65298c62483 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:18.026193 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0f31dd1b-49fc-4002-93eb-f65298c62483 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:18.042754 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0f31dd1b-49fc-4002-93eb-f65298c62483 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:18.044408 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-0f31dd1b-49fc-4002-93eb-f65298c62483 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.561898 Nov 23 07:45:18.045012 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 168/353] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:17 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:18.461217 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b26ed366-19e2-4f4b-8cfa-8c5535c45a4d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:18.461988 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-b26ed366-19e2-4f4b-8cfa-8c5535c45a4d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:18.469678 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b26ed366-19e2-4f4b-8cfa-8c5535c45a4d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:18.470209 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b26ed366-19e2-4f4b-8cfa-8c5535c45a4d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:18.471360 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b26ed366-19e2-4f4b-8cfa-8c5535c45a4d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:18.471960 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b26ed366-19e2-4f4b-8cfa-8c5535c45a4d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:18.558377 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b26ed366-19e2-4f4b-8cfa-8c5535c45a4d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:18.569807 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b26ed366-19e2-4f4b-8cfa-8c5535c45a4d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1272 microversion: 2.1 time: 0.113870 Nov 23 07:45:18.583048 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 186/354] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:18 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1272 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:18.841180 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-8f8675c3-949a-48f6-8870-dcd3e175d16e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:18.841902 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-8f8675c3-949a-48f6-8870-dcd3e175d16e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:18.849339 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8f8675c3-949a-48f6-8870-dcd3e175d16e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:18.849823 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8f8675c3-949a-48f6-8870-dcd3e175d16e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:18.850621 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8f8675c3-949a-48f6-8870-dcd3e175d16e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:18.851059 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8f8675c3-949a-48f6-8870-dcd3e175d16e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:19.063144 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a042272b-0b6d-4af9-94db-b1e20147ba79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:19.063756 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a042272b-0b6d-4af9-94db-b1e20147ba79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:19.070115 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a042272b-0b6d-4af9-94db-b1e20147ba79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:19.076631 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a042272b-0b6d-4af9-94db-b1e20147ba79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:19.077738 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a042272b-0b6d-4af9-94db-b1e20147ba79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:19.078345 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a042272b-0b6d-4af9-94db-b1e20147ba79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:19.228773 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-8f8675c3-949a-48f6-8870-dcd3e175d16e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:19.238288 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-8f8675c3-949a-48f6-8870-dcd3e175d16e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1724 microversion: 2.1 time: 0.401627 Nov 23 07:45:19.241688 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 169/355] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:18 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1724 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:19.289431 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a042272b-0b6d-4af9-94db-b1e20147ba79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:19.300508 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a042272b-0b6d-4af9-94db-b1e20147ba79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:19.303586 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a042272b-0b6d-4af9-94db-b1e20147ba79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:19.312853 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a042272b-0b6d-4af9-94db-b1e20147ba79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.253304 Nov 23 07:45:19.313694 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 187/356] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:19 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:45:19.594080 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-40e180c1-3fb5-4695-aad0-2cd3ce8440c6 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:19.594941 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-40e180c1-3fb5-4695-aad0-2cd3ce8440c6 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:19.602897 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40e180c1-3fb5-4695-aad0-2cd3ce8440c6 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:19.603772 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40e180c1-3fb5-4695-aad0-2cd3ce8440c6 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:19.604906 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40e180c1-3fb5-4695-aad0-2cd3ce8440c6 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:19.605313 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40e180c1-3fb5-4695-aad0-2cd3ce8440c6 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:20.103891 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-40e180c1-3fb5-4695-aad0-2cd3ce8440c6 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:20.115661 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-40e180c1-3fb5-4695-aad0-2cd3ce8440c6 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1314 microversion: 2.1 time: 0.527959 Nov 23 07:45:20.116457 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 170/357] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:19 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:20.245804 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-d4dd8de4-0b55-4362-808a-6cefc33e6427 req-f0be9fa9-1f84-48a9-90ce-da8dd8cf920e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd486dfc-f28a-4b35-ab29-ffe8daab8a69", "tag": "7abf5039-2cd0-48cc-93cd-f72b7d305c16"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:20.249053 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:45:20.249053 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:45:20.257453 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c9248716-d6fc-4b8f-bb83-6d379ea8ec0a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:20.259014 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c9248716-d6fc-4b8f-bb83-6d379ea8ec0a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:20.267292 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-d4dd8de4-0b55-4362-808a-6cefc33e6427 req-f0be9fa9-1f84-48a9-90ce-da8dd8cf920e service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:20.268032 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-d4dd8de4-0b55-4362-808a-6cefc33e6427 req-f0be9fa9-1f84-48a9-90ce-da8dd8cf920e service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:20.273022 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c9248716-d6fc-4b8f-bb83-6d379ea8ec0a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:20.273761 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c9248716-d6fc-4b8f-bb83-6d379ea8ec0a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:20.279847 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c9248716-d6fc-4b8f-bb83-6d379ea8ec0a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:20.280807 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c9248716-d6fc-4b8f-bb83-6d379ea8ec0a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:20.290396 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-d4dd8de4-0b55-4362-808a-6cefc33e6427 req-f0be9fa9-1f84-48a9-90ce-da8dd8cf920e service nova] Creating event network-changed:7abf5039-2cd0-48cc-93cd-f72b7d305c16 for instance cd486dfc-f28a-4b35-ab29-ffe8daab8a69 on hv-cinder-80403 Nov 23 07:45:20.296520 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-d4dd8de4-0b55-4362-808a-6cefc33e6427 req-f0be9fa9-1f84-48a9-90ce-da8dd8cf920e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055798 Nov 23 07:45:20.297139 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 188/358] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:45:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:45:20.340882 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ffc76219-a638-434e-af48-3ade829639b8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:20.341929 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ffc76219-a638-434e-af48-3ade829639b8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:20.349651 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ffc76219-a638-434e-af48-3ade829639b8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:20.350765 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ffc76219-a638-434e-af48-3ade829639b8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:20.351847 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ffc76219-a638-434e-af48-3ade829639b8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:20.352442 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ffc76219-a638-434e-af48-3ade829639b8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:20.576176 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ffc76219-a638-434e-af48-3ade829639b8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:20.584798 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ffc76219-a638-434e-af48-3ade829639b8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:20.587811 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ffc76219-a638-434e-af48-3ade829639b8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:20.589231 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ffc76219-a638-434e-af48-3ade829639b8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.255380 Nov 23 07:45:20.590431 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 189/359] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:20 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:20.609174 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c9248716-d6fc-4b8f-bb83-6d379ea8ec0a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:20.618307 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c9248716-d6fc-4b8f-bb83-6d379ea8ec0a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1724 microversion: 2.1 time: 0.364777 Nov 23 07:45:20.619985 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 171/360] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:20 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:20.869324 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b8ab9308-b12e-4621-a9eb-0bf6d5097993 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Action: 'create', calling method: .version_select at 0x7f0514997700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-991011702"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:20.885657 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-b8ab9308-b12e-4621-a9eb-0bf6d5097993 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Getting quotas for project c42cd8fcb71040c394c2fa2ed9324ae0. Resources: {'key_pairs'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:45:20.891001 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-b8ab9308-b12e-4621-a9eb-0bf6d5097993 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Getting quotas for user 88be99113c1a48049e7cb4184f8394bd and project c42cd8fcb71040c394c2fa2ed9324ae0. Resources: {'key_pairs'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:45:21.117365 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-b8ab9308-b12e-4621-a9eb-0bf6d5097993 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Getting quotas for project c42cd8fcb71040c394c2fa2ed9324ae0. Resources: {'key_pairs'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:45:21.121220 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-b8ab9308-b12e-4621-a9eb-0bf6d5097993 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Getting quotas for user 88be99113c1a48049e7cb4184f8394bd and project c42cd8fcb71040c394c2fa2ed9324ae0. Resources: {'key_pairs'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:45:21.135196 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f3dfadf0-09d1-47e1-8a3e-8c36cffc7c72 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:21.135852 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f3dfadf0-09d1-47e1-8a3e-8c36cffc7c72 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:21.140610 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b8ab9308-b12e-4621-a9eb-0bf6d5097993 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.275380 Nov 23 07:45:21.141388 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 190/361] 10.222.0.48 () {60 vars in 1157 bytes} [Tue Nov 23 07:45:20 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:21.142429 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f3dfadf0-09d1-47e1-8a3e-8c36cffc7c72 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:21.142953 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f3dfadf0-09d1-47e1-8a3e-8c36cffc7c72 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:21.144129 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f3dfadf0-09d1-47e1-8a3e-8c36cffc7c72 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:21.144660 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f3dfadf0-09d1-47e1-8a3e-8c36cffc7c72 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:21.213145 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-bd2b24ca-240c-43de-b1b9-f698c21bc6ce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1830618737", "imageRef": "a60d35c8-7391-4e1f-82de-64ac3bf4c779", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-991011702", "networks": [{"uuid": "1b5d852b-b97c-4e33-b149-2a4c0450e4d5"}]}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:21.344328 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.network.neutron [None req-bd2b24ca-240c-43de-b1b9-f698c21bc6ce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] validate_networks() for [('1b5d852b-b97c-4e33-b149-2a4c0450e4d5', None, None, None, None, None)] {{(pid=122786) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:45:21.479602 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f3dfadf0-09d1-47e1-8a3e-8c36cffc7c72 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:21.489284 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f3dfadf0-09d1-47e1-8a3e-8c36cffc7c72 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1314 microversion: 2.1 time: 0.359321 Nov 23 07:45:21.498663 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 172/362] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:21 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:21.610474 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-0a043927-0177-45d3-80c1-5fc55b91e3f7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:21.611115 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-0a043927-0177-45d3-80c1-5fc55b91e3f7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:21.623942 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0a043927-0177-45d3-80c1-5fc55b91e3f7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:21.624396 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0a043927-0177-45d3-80c1-5fc55b91e3f7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:21.625197 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0a043927-0177-45d3-80c1-5fc55b91e3f7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:21.625634 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0a043927-0177-45d3-80c1-5fc55b91e3f7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:21.814570 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0a043927-0177-45d3-80c1-5fc55b91e3f7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:21.822608 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-bd2b24ca-240c-43de-b1b9-f698c21bc6ce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Flavor limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:45:21.823491 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-bd2b24ca-240c-43de-b1b9-f698c21bc6ce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Image limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:45:21.824280 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0a043927-0177-45d3-80c1-5fc55b91e3f7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:21.826066 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0a043927-0177-45d3-80c1-5fc55b91e3f7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:21.827313 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-0a043927-0177-45d3-80c1-5fc55b91e3f7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.220636 Nov 23 07:45:21.827888 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 173/363] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:21 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:45:21.829031 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-bd2b24ca-240c-43de-b1b9-f698c21bc6ce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Flavor pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:45:21.829618 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-bd2b24ca-240c-43de-b1b9-f698c21bc6ce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Image pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:45:21.830265 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-bd2b24ca-240c-43de-b1b9-f698c21bc6ce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:45:21.832495 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-7a33f4e8-b80c-45c8-87e0-1bcbd43924a8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:21.833104 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-7a33f4e8-b80c-45c8-87e0-1bcbd43924a8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:21.839297 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7a33f4e8-b80c-45c8-87e0-1bcbd43924a8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:21.839747 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7a33f4e8-b80c-45c8-87e0-1bcbd43924a8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:21.840828 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7a33f4e8-b80c-45c8-87e0-1bcbd43924a8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:21.841278 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7a33f4e8-b80c-45c8-87e0-1bcbd43924a8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:21.849845 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bd2b24ca-240c-43de-b1b9-f698c21bc6ce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:21.850474 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bd2b24ca-240c-43de-b1b9-f698c21bc6ce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:21.851606 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bd2b24ca-240c-43de-b1b9-f698c21bc6ce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:21.852390 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bd2b24ca-240c-43de-b1b9-f698c21bc6ce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:21.871670 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-bd2b24ca-240c-43de-b1b9-f698c21bc6ce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Getting quotas for project c42cd8fcb71040c394c2fa2ed9324ae0. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:45:21.875641 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-bd2b24ca-240c-43de-b1b9-f698c21bc6ce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Getting quotas for user 88be99113c1a48049e7cb4184f8394bd and project c42cd8fcb71040c394c2fa2ed9324ae0. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:45:21.887803 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-bd2b24ca-240c-43de-b1b9-f698c21bc6ce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Going to run 1 instances... {{(pid=122786) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:45:21.891248 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-bd2b24ca-240c-43de-b1b9-f698c21bc6ce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a60d35c8-7391-4e1f-82de-64ac3bf4c779',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:45:21.941480 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-bd2b24ca-240c-43de-b1b9-f698c21bc6ce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733598 Nov 23 07:45:21.942363 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 191/364] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Nov 23 07:45:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 07:45:21.951738 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e2934093-85b1-4a29-abb0-afee0bbdb00e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:21.952395 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e2934093-85b1-4a29-abb0-afee0bbdb00e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:22.014862 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-7a33f4e8-b80c-45c8-87e0-1bcbd43924a8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:22.017798 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-e2934093-85b1-4a29-abb0-afee0bbdb00e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:22.025432 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e2934093-85b1-4a29-abb0-afee0bbdb00e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1258 microversion: 2.1 time: 0.076663 Nov 23 07:45:22.026483 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-7a33f4e8-b80c-45c8-87e0-1bcbd43924a8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1724 microversion: 2.1 time: 0.195934 Nov 23 07:45:22.026751 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 192/365] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:21 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:22.027102 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 174/366] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:21 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:22.506669 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-77b8d212-a097-43d8-bc78-2ca991953f08 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:22.507290 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-77b8d212-a097-43d8-bc78-2ca991953f08 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:22.515480 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-77b8d212-a097-43d8-bc78-2ca991953f08 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:22.515855 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-77b8d212-a097-43d8-bc78-2ca991953f08 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:22.516641 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-77b8d212-a097-43d8-bc78-2ca991953f08 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:22.517117 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-77b8d212-a097-43d8-bc78-2ca991953f08 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:22.675298 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-77b8d212-a097-43d8-bc78-2ca991953f08 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:22.684658 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-77b8d212-a097-43d8-bc78-2ca991953f08 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1314 microversion: 2.1 time: 0.182757 Nov 23 07:45:22.685240 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 193/367] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:22 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:22.845880 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5db34cc7-3fca-487a-8021-c5d933af9529 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:22.845880 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5db34cc7-3fca-487a-8021-c5d933af9529 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:22.854085 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5db34cc7-3fca-487a-8021-c5d933af9529 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:22.854579 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5db34cc7-3fca-487a-8021-c5d933af9529 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:22.855333 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5db34cc7-3fca-487a-8021-c5d933af9529 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:22.855770 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5db34cc7-3fca-487a-8021-c5d933af9529 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:23.010314 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5db34cc7-3fca-487a-8021-c5d933af9529 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:23.020136 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5db34cc7-3fca-487a-8021-c5d933af9529 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:23.023450 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5db34cc7-3fca-487a-8021-c5d933af9529 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:23.026170 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5db34cc7-3fca-487a-8021-c5d933af9529 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.183733 Nov 23 07:45:23.031213 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 175/368] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:22 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:23.055420 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-87c4f754-d243-4524-b424-b757ed427614 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:23.056330 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-87c4f754-d243-4524-b424-b757ed427614 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:23.056558 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ada1f1f7-c5bd-4f94-8500-9804c6578d09 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:23.057256 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ada1f1f7-c5bd-4f94-8500-9804c6578d09 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:23.064450 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-87c4f754-d243-4524-b424-b757ed427614 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:23.065128 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ada1f1f7-c5bd-4f94-8500-9804c6578d09 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:23.065651 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ada1f1f7-c5bd-4f94-8500-9804c6578d09 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:23.066560 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ada1f1f7-c5bd-4f94-8500-9804c6578d09 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:23.067001 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ada1f1f7-c5bd-4f94-8500-9804c6578d09 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:23.067813 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-87c4f754-d243-4524-b424-b757ed427614 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:23.068805 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-87c4f754-d243-4524-b424-b757ed427614 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:23.069257 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-87c4f754-d243-4524-b424-b757ed427614 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:23.144824 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ada1f1f7-c5bd-4f94-8500-9804c6578d09 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:23.155606 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ada1f1f7-c5bd-4f94-8500-9804c6578d09 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1310 microversion: 2.1 time: 0.103446 Nov 23 07:45:23.160844 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 176/369] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:23 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1310 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:23.229271 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-87c4f754-d243-4524-b424-b757ed427614 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:23.237476 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-87c4f754-d243-4524-b424-b757ed427614 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1724 microversion: 2.1 time: 0.186189 Nov 23 07:45:23.248465 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 194/370] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:23 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:23.713960 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-e0c63407-b9df-4f0d-b8fe-34fc4e8d7b22 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:23.713960 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-e0c63407-b9df-4f0d-b8fe-34fc4e8d7b22 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:23.713960 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e0c63407-b9df-4f0d-b8fe-34fc4e8d7b22 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:23.714889 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e0c63407-b9df-4f0d-b8fe-34fc4e8d7b22 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:23.717519 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e0c63407-b9df-4f0d-b8fe-34fc4e8d7b22 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:23.718373 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e0c63407-b9df-4f0d-b8fe-34fc4e8d7b22 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:24.048391 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-58af4b6c-e076-4767-bf5d-40dcf9e92988 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:24.050601 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-58af4b6c-e076-4767-bf5d-40dcf9e92988 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:24.079283 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-58af4b6c-e076-4767-bf5d-40dcf9e92988 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:24.083922 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-58af4b6c-e076-4767-bf5d-40dcf9e92988 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:24.085959 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-58af4b6c-e076-4767-bf5d-40dcf9e92988 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:24.089261 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-58af4b6c-e076-4767-bf5d-40dcf9e92988 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:24.384397 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-58af4b6c-e076-4767-bf5d-40dcf9e92988 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:24.404418 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-58af4b6c-e076-4767-bf5d-40dcf9e92988 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:24.411656 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-58af4b6c-e076-4767-bf5d-40dcf9e92988 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:24.412883 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-58af4b6c-e076-4767-bf5d-40dcf9e92988 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.371115 Nov 23 07:45:24.413459 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 195/371] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:24 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:45:24.423979 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-e0c63407-b9df-4f0d-b8fe-34fc4e8d7b22 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:24.435754 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-e0c63407-b9df-4f0d-b8fe-34fc4e8d7b22 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1314 microversion: 2.1 time: 0.736748 Nov 23 07:45:24.453822 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 177/372] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:23 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1314 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:24.454097 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a13cba6c-b5dd-4de3-8821-27d6a1cd89d6 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:24.454214 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-46312f5b-6053-43d1-b007-53be1804a3ce tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:24.454214 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-46312f5b-6053-43d1-b007-53be1804a3ce tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:24.454392 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a13cba6c-b5dd-4de3-8821-27d6a1cd89d6 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:24.454498 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-46312f5b-6053-43d1-b007-53be1804a3ce tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:24.454951 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-46312f5b-6053-43d1-b007-53be1804a3ce tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:24.456250 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-46312f5b-6053-43d1-b007-53be1804a3ce tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:24.456959 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-46312f5b-6053-43d1-b007-53be1804a3ce tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:24.469107 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a13cba6c-b5dd-4de3-8821-27d6a1cd89d6 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:24.469559 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a13cba6c-b5dd-4de3-8821-27d6a1cd89d6 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:24.470471 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a13cba6c-b5dd-4de3-8821-27d6a1cd89d6 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:24.471018 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a13cba6c-b5dd-4de3-8821-27d6a1cd89d6 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:24.746977 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a13cba6c-b5dd-4de3-8821-27d6a1cd89d6 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:24.756633 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a13cba6c-b5dd-4de3-8821-27d6a1cd89d6 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1358 microversion: 2.1 time: 0.337319 Nov 23 07:45:24.759934 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 196/373] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:24 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1358 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:24.817184 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-46312f5b-6053-43d1-b007-53be1804a3ce tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:24.826154 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-46312f5b-6053-43d1-b007-53be1804a3ce tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1724 microversion: 2.1 time: 0.386163 Nov 23 07:45:24.837963 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 178/374] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:24 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1724 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:25.431310 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ac580162-89bf-4c3e-9b7f-ea3ae2f1a733 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:25.431948 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ac580162-89bf-4c3e-9b7f-ea3ae2f1a733 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:25.438463 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ac580162-89bf-4c3e-9b7f-ea3ae2f1a733 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:25.438920 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ac580162-89bf-4c3e-9b7f-ea3ae2f1a733 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:25.439692 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ac580162-89bf-4c3e-9b7f-ea3ae2f1a733 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:25.440125 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ac580162-89bf-4c3e-9b7f-ea3ae2f1a733 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:25.468652 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-de16cffc-e195-48c3-9c1e-1685d3b7b523 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:25.469262 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-de16cffc-e195-48c3-9c1e-1685d3b7b523 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:25.476951 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-de16cffc-e195-48c3-9c1e-1685d3b7b523 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:25.477458 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-de16cffc-e195-48c3-9c1e-1685d3b7b523 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:25.478430 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-de16cffc-e195-48c3-9c1e-1685d3b7b523 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:25.480408 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-de16cffc-e195-48c3-9c1e-1685d3b7b523 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:25.595382 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ac580162-89bf-4c3e-9b7f-ea3ae2f1a733 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:25.608675 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ac580162-89bf-4c3e-9b7f-ea3ae2f1a733 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:25.611088 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ac580162-89bf-4c3e-9b7f-ea3ae2f1a733 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:25.613440 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ac580162-89bf-4c3e-9b7f-ea3ae2f1a733 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.185895 Nov 23 07:45:25.614303 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 197/375] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:25 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:25.636876 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-de16cffc-e195-48c3-9c1e-1685d3b7b523 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:25.646235 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-de16cffc-e195-48c3-9c1e-1685d3b7b523 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1314 microversion: 2.1 time: 0.180992 Nov 23 07:45:25.646902 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 179/376] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:25 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:25.776357 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4e4a607d-160b-454f-b21a-538c8702a5fd tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:25.776895 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4e4a607d-160b-454f-b21a-538c8702a5fd tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:25.783407 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4e4a607d-160b-454f-b21a-538c8702a5fd tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:25.783855 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4e4a607d-160b-454f-b21a-538c8702a5fd tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:25.784650 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4e4a607d-160b-454f-b21a-538c8702a5fd tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:25.785147 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4e4a607d-160b-454f-b21a-538c8702a5fd tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:25.845181 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c6272d4f-5310-4a1d-8ef9-9627947c3f1f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:25.846204 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c6272d4f-5310-4a1d-8ef9-9627947c3f1f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:25.867367 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c6272d4f-5310-4a1d-8ef9-9627947c3f1f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:25.867818 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c6272d4f-5310-4a1d-8ef9-9627947c3f1f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:25.869275 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c6272d4f-5310-4a1d-8ef9-9627947c3f1f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:25.869730 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c6272d4f-5310-4a1d-8ef9-9627947c3f1f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:25.976190 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-4e4a607d-160b-454f-b21a-538c8702a5fd tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:25.983820 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4e4a607d-160b-454f-b21a-538c8702a5fd tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1358 microversion: 2.1 time: 0.211376 Nov 23 07:45:25.985079 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 198/377] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:25 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:26.025188 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c6272d4f-5310-4a1d-8ef9-9627947c3f1f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:26.035864 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c6272d4f-5310-4a1d-8ef9-9627947c3f1f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1724 microversion: 2.1 time: 0.195863 Nov 23 07:45:26.036500 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 180/378] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:25 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:26.633586 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-02c75a0a-f04c-4499-a737-3c28eb94a4d6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:26.634297 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-02c75a0a-f04c-4499-a737-3c28eb94a4d6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:26.641496 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-02c75a0a-f04c-4499-a737-3c28eb94a4d6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:26.641998 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-02c75a0a-f04c-4499-a737-3c28eb94a4d6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:26.642945 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-02c75a0a-f04c-4499-a737-3c28eb94a4d6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:26.643411 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-02c75a0a-f04c-4499-a737-3c28eb94a4d6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:26.663751 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-15b27114-b5e5-41c5-88cc-97a1351b0082 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:26.666451 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-15b27114-b5e5-41c5-88cc-97a1351b0082 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:26.674091 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-15b27114-b5e5-41c5-88cc-97a1351b0082 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:26.674718 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-15b27114-b5e5-41c5-88cc-97a1351b0082 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:26.675744 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-15b27114-b5e5-41c5-88cc-97a1351b0082 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:26.676371 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-15b27114-b5e5-41c5-88cc-97a1351b0082 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:26.850826 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-02c75a0a-f04c-4499-a737-3c28eb94a4d6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:26.862658 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-02c75a0a-f04c-4499-a737-3c28eb94a4d6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:26.864223 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-02c75a0a-f04c-4499-a737-3c28eb94a4d6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:26.865302 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-02c75a0a-f04c-4499-a737-3c28eb94a4d6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.235664 Nov 23 07:45:26.865899 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 199/379] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:26 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:26.871695 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-15b27114-b5e5-41c5-88cc-97a1351b0082 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:26.880098 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-15b27114-b5e5-41c5-88cc-97a1351b0082 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1314 microversion: 2.1 time: 0.220232 Nov 23 07:45:26.880870 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 181/380] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:26 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:27.003185 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b8b6943d-545d-431f-aace-8b4fc64a0c2c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:27.004089 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-b8b6943d-545d-431f-aace-8b4fc64a0c2c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:27.011776 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b8b6943d-545d-431f-aace-8b4fc64a0c2c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:27.012386 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b8b6943d-545d-431f-aace-8b4fc64a0c2c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:27.013195 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b8b6943d-545d-431f-aace-8b4fc64a0c2c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:27.014936 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b8b6943d-545d-431f-aace-8b4fc64a0c2c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:27.054113 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-a6cd9c6d-420f-4a51-9755-0a06c946c8c6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:27.054719 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-a6cd9c6d-420f-4a51-9755-0a06c946c8c6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:27.061152 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a6cd9c6d-420f-4a51-9755-0a06c946c8c6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:27.061593 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a6cd9c6d-420f-4a51-9755-0a06c946c8c6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:27.062401 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a6cd9c6d-420f-4a51-9755-0a06c946c8c6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:27.062913 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a6cd9c6d-420f-4a51-9755-0a06c946c8c6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:27.175440 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b8b6943d-545d-431f-aace-8b4fc64a0c2c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:27.183194 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b8b6943d-545d-431f-aace-8b4fc64a0c2c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1358 microversion: 2.1 time: 0.184681 Nov 23 07:45:27.184096 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 200/381] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:26 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:27.231225 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a6cd9c6d-420f-4a51-9755-0a06c946c8c6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:27.240686 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-a6cd9c6d-420f-4a51-9755-0a06c946c8c6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1724 microversion: 2.1 time: 0.189809 Nov 23 07:45:27.241502 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 182/382] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:27 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:27.884982 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b3876720-24f4-4cb8-85a7-c7077ef98206 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:27.885631 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-b3876720-24f4-4cb8-85a7-c7077ef98206 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:27.898196 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-724cd2a7-cf4f-4f95-ba6c-b5c8b2afb08c tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:27.898786 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-724cd2a7-cf4f-4f95-ba6c-b5c8b2afb08c tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:27.914616 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-724cd2a7-cf4f-4f95-ba6c-b5c8b2afb08c tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:27.914942 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b3876720-24f4-4cb8-85a7-c7077ef98206 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:27.915827 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-724cd2a7-cf4f-4f95-ba6c-b5c8b2afb08c tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:27.916059 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b3876720-24f4-4cb8-85a7-c7077ef98206 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:27.916879 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b3876720-24f4-4cb8-85a7-c7077ef98206 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:27.917193 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-724cd2a7-cf4f-4f95-ba6c-b5c8b2afb08c tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:27.917305 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b3876720-24f4-4cb8-85a7-c7077ef98206 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:27.918884 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-724cd2a7-cf4f-4f95-ba6c-b5c8b2afb08c tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:28.141784 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b3876720-24f4-4cb8-85a7-c7077ef98206 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:28.153175 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b3876720-24f4-4cb8-85a7-c7077ef98206 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:28.158411 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b3876720-24f4-4cb8-85a7-c7077ef98206 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:28.162765 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b3876720-24f4-4cb8-85a7-c7077ef98206 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.281929 Nov 23 07:45:28.164466 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 201/383] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:27 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:28.182268 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-0d876a51-3b7c-48e2-8dcc-dde99a5824da req-a9f6e915-22f0-4eac-9785-3d1f76b11d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd486dfc-f28a-4b35-ab29-ffe8daab8a69", "name": "network-vif-plugged", "status": "completed", "tag": "7abf5039-2cd0-48cc-93cd-f72b7d305c16"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:28.185017 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:45:28.185017 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:45:28.195867 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-724cd2a7-cf4f-4f95-ba6c-b5c8b2afb08c tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:28.196711 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-0d876a51-3b7c-48e2-8dcc-dde99a5824da req-a9f6e915-22f0-4eac-9785-3d1f76b11d43 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:28.197369 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-0d876a51-3b7c-48e2-8dcc-dde99a5824da req-a9f6e915-22f0-4eac-9785-3d1f76b11d43 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:28.207714 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-724cd2a7-cf4f-4f95-ba6c-b5c8b2afb08c tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1314 microversion: 2.1 time: 0.313481 Nov 23 07:45:28.208521 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 183/384] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:27 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:28.214200 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-728efcc8-70c0-4da4-80cb-d3d1905fd420 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:28.215428 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-728efcc8-70c0-4da4-80cb-d3d1905fd420 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:28.224749 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-728efcc8-70c0-4da4-80cb-d3d1905fd420 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:28.224749 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-728efcc8-70c0-4da4-80cb-d3d1905fd420 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:28.224749 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-728efcc8-70c0-4da4-80cb-d3d1905fd420 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:28.224749 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-728efcc8-70c0-4da4-80cb-d3d1905fd420 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:28.230200 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-0d876a51-3b7c-48e2-8dcc-dde99a5824da req-a9f6e915-22f0-4eac-9785-3d1f76b11d43 service nova] Creating event network-vif-plugged:7abf5039-2cd0-48cc-93cd-f72b7d305c16 for instance cd486dfc-f28a-4b35-ab29-ffe8daab8a69 on hv-cinder-80403 Nov 23 07:45:28.237385 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-0d876a51-3b7c-48e2-8dcc-dde99a5824da req-a9f6e915-22f0-4eac-9785-3d1f76b11d43 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067259 Nov 23 07:45:28.238333 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 202/385] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:45:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:45:28.265277 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-2968bf40-7de5-4b08-b064-d5bfca0001e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:28.266294 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-2968bf40-7de5-4b08-b064-d5bfca0001e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:28.275190 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2968bf40-7de5-4b08-b064-d5bfca0001e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:28.276110 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2968bf40-7de5-4b08-b064-d5bfca0001e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:28.277574 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2968bf40-7de5-4b08-b064-d5bfca0001e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:28.278243 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2968bf40-7de5-4b08-b064-d5bfca0001e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:28.454671 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-728efcc8-70c0-4da4-80cb-d3d1905fd420 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:28.468705 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-728efcc8-70c0-4da4-80cb-d3d1905fd420 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1358 microversion: 2.1 time: 0.259086 Nov 23 07:45:28.469757 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 184/386] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:28 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:28.482103 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2968bf40-7de5-4b08-b064-d5bfca0001e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:28.490591 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-2968bf40-7de5-4b08-b064-d5bfca0001e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1724 microversion: 2.1 time: 0.234132 Nov 23 07:45:28.491145 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 203/387] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:28 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:29.183974 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-6dbee05d-34d5-4444-be68-7e67089848a1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:29.184654 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-6dbee05d-34d5-4444-be68-7e67089848a1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:29.191483 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6dbee05d-34d5-4444-be68-7e67089848a1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:29.191933 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6dbee05d-34d5-4444-be68-7e67089848a1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:29.192797 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6dbee05d-34d5-4444-be68-7e67089848a1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:29.193236 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6dbee05d-34d5-4444-be68-7e67089848a1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:29.235046 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c5e912f6-393f-4489-8961-3e7e4547b865 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:29.235863 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c5e912f6-393f-4489-8961-3e7e4547b865 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:29.242300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c5e912f6-393f-4489-8961-3e7e4547b865 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:29.242752 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c5e912f6-393f-4489-8961-3e7e4547b865 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:29.244177 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c5e912f6-393f-4489-8961-3e7e4547b865 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:29.244616 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c5e912f6-393f-4489-8961-3e7e4547b865 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:29.380755 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-6dbee05d-34d5-4444-be68-7e67089848a1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:29.389511 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-6dbee05d-34d5-4444-be68-7e67089848a1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:29.393043 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-6dbee05d-34d5-4444-be68-7e67089848a1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:29.396460 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-6dbee05d-34d5-4444-be68-7e67089848a1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.217240 Nov 23 07:45:29.397051 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 185/388] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:29 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:29.411129 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-c5e912f6-393f-4489-8961-3e7e4547b865 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:29.423203 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c5e912f6-393f-4489-8961-3e7e4547b865 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1314 microversion: 2.1 time: 0.191985 Nov 23 07:45:29.423978 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 204/389] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:29 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:29.489113 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-e33a8761-7e06-4e8e-bdfd-a4ca8215d393 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:29.490185 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-e33a8761-7e06-4e8e-bdfd-a4ca8215d393 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:29.496698 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e33a8761-7e06-4e8e-bdfd-a4ca8215d393 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:29.497232 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e33a8761-7e06-4e8e-bdfd-a4ca8215d393 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:29.498147 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e33a8761-7e06-4e8e-bdfd-a4ca8215d393 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:29.498640 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e33a8761-7e06-4e8e-bdfd-a4ca8215d393 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:29.508658 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e2507c8e-66f1-4845-8263-f98f46241ac9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:29.509284 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e2507c8e-66f1-4845-8263-f98f46241ac9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:29.515855 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e2507c8e-66f1-4845-8263-f98f46241ac9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:29.516373 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e2507c8e-66f1-4845-8263-f98f46241ac9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:29.517084 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e2507c8e-66f1-4845-8263-f98f46241ac9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:29.517519 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e2507c8e-66f1-4845-8263-f98f46241ac9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:29.663484 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-e33a8761-7e06-4e8e-bdfd-a4ca8215d393 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:29.671718 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-e33a8761-7e06-4e8e-bdfd-a4ca8215d393 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1358 microversion: 2.1 time: 0.187210 Nov 23 07:45:29.672291 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 186/390] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:29 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:29.676696 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-e2507c8e-66f1-4845-8263-f98f46241ac9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:29.684903 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e2507c8e-66f1-4845-8263-f98f46241ac9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1724 microversion: 2.1 time: 0.180171 Nov 23 07:45:29.685663 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 205/391] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:29 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:30.416782 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-7db63b78-d07e-4650-9d43-6f89f5ef0020 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:30.417476 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-7db63b78-d07e-4650-9d43-6f89f5ef0020 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:30.424734 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7db63b78-d07e-4650-9d43-6f89f5ef0020 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:30.425180 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7db63b78-d07e-4650-9d43-6f89f5ef0020 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:30.426017 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7db63b78-d07e-4650-9d43-6f89f5ef0020 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:30.426527 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7db63b78-d07e-4650-9d43-6f89f5ef0020 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:30.447995 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-306f350c-b5a2-4ead-865e-7784931b096d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:30.448978 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-306f350c-b5a2-4ead-865e-7784931b096d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:30.458309 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-306f350c-b5a2-4ead-865e-7784931b096d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:30.459348 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-306f350c-b5a2-4ead-865e-7784931b096d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:30.460648 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-306f350c-b5a2-4ead-865e-7784931b096d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:30.461325 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-306f350c-b5a2-4ead-865e-7784931b096d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:30.614993 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-7db63b78-d07e-4650-9d43-6f89f5ef0020 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:30.623994 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-7db63b78-d07e-4650-9d43-6f89f5ef0020 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:30.625521 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-7db63b78-d07e-4650-9d43-6f89f5ef0020 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:30.626729 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-7db63b78-d07e-4650-9d43-6f89f5ef0020 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.214503 Nov 23 07:45:30.627292 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 187/392] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:30 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:30.650987 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-306f350c-b5a2-4ead-865e-7784931b096d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:30.659077 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-306f350c-b5a2-4ead-865e-7784931b096d tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1314 microversion: 2.1 time: 0.217841 Nov 23 07:45:30.659652 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 206/393] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:30 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:30.688232 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5dddf08c-8b72-4e0f-a3ce-328aa0964cce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:30.688755 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5dddf08c-8b72-4e0f-a3ce-328aa0964cce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:30.694800 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5dddf08c-8b72-4e0f-a3ce-328aa0964cce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:30.695253 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5dddf08c-8b72-4e0f-a3ce-328aa0964cce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:30.696034 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5dddf08c-8b72-4e0f-a3ce-328aa0964cce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:30.696501 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5dddf08c-8b72-4e0f-a3ce-328aa0964cce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:30.702851 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-312ddce7-5a32-46e1-97ff-03be8f4a04db tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:30.703554 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-312ddce7-5a32-46e1-97ff-03be8f4a04db tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:30.709512 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-312ddce7-5a32-46e1-97ff-03be8f4a04db tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:30.710094 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-312ddce7-5a32-46e1-97ff-03be8f4a04db tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:30.710925 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-312ddce7-5a32-46e1-97ff-03be8f4a04db tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:30.711431 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-312ddce7-5a32-46e1-97ff-03be8f4a04db tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:30.865891 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5dddf08c-8b72-4e0f-a3ce-328aa0964cce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:30.873425 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5dddf08c-8b72-4e0f-a3ce-328aa0964cce tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1358 microversion: 2.1 time: 0.188873 Nov 23 07:45:30.874045 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 188/394] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:30 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:30.875300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-312ddce7-5a32-46e1-97ff-03be8f4a04db tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:30.883188 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-312ddce7-5a32-46e1-97ff-03be8f4a04db tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1724 microversion: 2.1 time: 0.183939 Nov 23 07:45:30.884417 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 207/395] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:30 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:31.644866 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f6dec2cc-621d-456a-b506-9168fc81748e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:31.645490 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f6dec2cc-621d-456a-b506-9168fc81748e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:31.652804 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f6dec2cc-621d-456a-b506-9168fc81748e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:31.653255 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f6dec2cc-621d-456a-b506-9168fc81748e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:31.654155 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f6dec2cc-621d-456a-b506-9168fc81748e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:31.654643 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f6dec2cc-621d-456a-b506-9168fc81748e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:31.678863 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b762759b-4615-4e47-80b3-fa25f5fce54a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:31.679749 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-b762759b-4615-4e47-80b3-fa25f5fce54a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:31.700131 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b762759b-4615-4e47-80b3-fa25f5fce54a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:31.700783 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b762759b-4615-4e47-80b3-fa25f5fce54a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:31.701574 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b762759b-4615-4e47-80b3-fa25f5fce54a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:31.702110 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b762759b-4615-4e47-80b3-fa25f5fce54a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:31.835493 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f6dec2cc-621d-456a-b506-9168fc81748e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:31.844314 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f6dec2cc-621d-456a-b506-9168fc81748e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:31.845915 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f6dec2cc-621d-456a-b506-9168fc81748e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:31.847375 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f6dec2cc-621d-456a-b506-9168fc81748e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.206404 Nov 23 07:45:31.848152 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 189/396] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:31 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:31.886671 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b762759b-4615-4e47-80b3-fa25f5fce54a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:31.890643 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-7a6b2873-f3b9-401d-aa80-67a0e5914635 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:31.891255 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-7a6b2873-f3b9-401d-aa80-67a0e5914635 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:31.896017 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b762759b-4615-4e47-80b3-fa25f5fce54a tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1314 microversion: 2.1 time: 0.222314 Nov 23 07:45:31.896644 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 208/397] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:31 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:31.897159 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7a6b2873-f3b9-401d-aa80-67a0e5914635 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:31.899094 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7a6b2873-f3b9-401d-aa80-67a0e5914635 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:31.900452 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7a6b2873-f3b9-401d-aa80-67a0e5914635 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:31.900897 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7a6b2873-f3b9-401d-aa80-67a0e5914635 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:31.906839 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-52ee35af-7a28-424e-9bd8-853bfb376c03 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:31.907448 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-52ee35af-7a28-424e-9bd8-853bfb376c03 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:31.913588 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-52ee35af-7a28-424e-9bd8-853bfb376c03 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:31.914331 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-52ee35af-7a28-424e-9bd8-853bfb376c03 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:31.915191 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-52ee35af-7a28-424e-9bd8-853bfb376c03 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:31.915638 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-52ee35af-7a28-424e-9bd8-853bfb376c03 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:32.059036 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-7a6b2873-f3b9-401d-aa80-67a0e5914635 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:32.068079 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-7a6b2873-f3b9-401d-aa80-67a0e5914635 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1358 microversion: 2.1 time: 0.181267 Nov 23 07:45:32.068977 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 190/398] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:31 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:32.093738 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-52ee35af-7a28-424e-9bd8-853bfb376c03 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:32.112991 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-52ee35af-7a28-424e-9bd8-853bfb376c03 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1724 microversion: 2.1 time: 0.209336 Nov 23 07:45:32.114011 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 209/399] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:31 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:32.866722 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-54ddd688-4bf3-405e-a892-feb77fe5172d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:32.867483 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-54ddd688-4bf3-405e-a892-feb77fe5172d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:32.875119 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-54ddd688-4bf3-405e-a892-feb77fe5172d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:32.875572 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-54ddd688-4bf3-405e-a892-feb77fe5172d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:32.876486 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-54ddd688-4bf3-405e-a892-feb77fe5172d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:32.876921 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-54ddd688-4bf3-405e-a892-feb77fe5172d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:32.913397 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-cd7ffc1a-2873-49f4-8a10-901d13e17acf tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:32.914416 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-cd7ffc1a-2873-49f4-8a10-901d13e17acf tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:32.921521 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cd7ffc1a-2873-49f4-8a10-901d13e17acf tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:32.922019 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cd7ffc1a-2873-49f4-8a10-901d13e17acf tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:32.922815 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cd7ffc1a-2873-49f4-8a10-901d13e17acf tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:32.923252 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cd7ffc1a-2873-49f4-8a10-901d13e17acf tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:33.042021 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-54ddd688-4bf3-405e-a892-feb77fe5172d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:33.051428 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-54ddd688-4bf3-405e-a892-feb77fe5172d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:33.061678 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-54ddd688-4bf3-405e-a892-feb77fe5172d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:33.063212 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-54ddd688-4bf3-405e-a892-feb77fe5172d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.200346 Nov 23 07:45:33.070511 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 191/400] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:32 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:45:33.091200 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-96618e26-ad14-4895-ab57-2e7c610aedaf tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:33.091817 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-96618e26-ad14-4895-ab57-2e7c610aedaf tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:33.100214 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-96618e26-ad14-4895-ab57-2e7c610aedaf tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:33.100792 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-96618e26-ad14-4895-ab57-2e7c610aedaf tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:33.102180 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-96618e26-ad14-4895-ab57-2e7c610aedaf tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:33.103385 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-96618e26-ad14-4895-ab57-2e7c610aedaf tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:33.109205 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-cd7ffc1a-2873-49f4-8a10-901d13e17acf tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:33.122906 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-cd7ffc1a-2873-49f4-8a10-901d13e17acf tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1314 microversion: 2.1 time: 0.213086 Nov 23 07:45:33.123648 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 210/401] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:32 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:33.136268 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-9d3594fd-5f15-4175-a74f-bf8794b8df23 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:33.136975 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-9d3594fd-5f15-4175-a74f-bf8794b8df23 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:33.146393 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9d3594fd-5f15-4175-a74f-bf8794b8df23 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:33.146936 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9d3594fd-5f15-4175-a74f-bf8794b8df23 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:33.147644 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9d3594fd-5f15-4175-a74f-bf8794b8df23 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:33.148087 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9d3594fd-5f15-4175-a74f-bf8794b8df23 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:33.331674 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-96618e26-ad14-4895-ab57-2e7c610aedaf tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:33.343231 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-96618e26-ad14-4895-ab57-2e7c610aedaf tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1358 microversion: 2.1 time: 0.256497 Nov 23 07:45:33.344149 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 192/402] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:33 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1358 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:33.358358 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-9d3594fd-5f15-4175-a74f-bf8794b8df23 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:33.367618 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-9d3594fd-5f15-4175-a74f-bf8794b8df23 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1724 microversion: 2.1 time: 0.235364 Nov 23 07:45:33.369414 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 211/403] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:33 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:34.091629 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d1618d46-fae7-4f1f-8660-67d8e560850e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:34.093054 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d1618d46-fae7-4f1f-8660-67d8e560850e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:34.104125 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d1618d46-fae7-4f1f-8660-67d8e560850e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:34.104716 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d1618d46-fae7-4f1f-8660-67d8e560850e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:34.105807 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d1618d46-fae7-4f1f-8660-67d8e560850e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:34.106430 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d1618d46-fae7-4f1f-8660-67d8e560850e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:34.142991 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-9a53f992-471d-476a-9965-d8876728633b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:34.143666 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-9a53f992-471d-476a-9965-d8876728633b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:34.162376 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9a53f992-471d-476a-9965-d8876728633b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:34.162856 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9a53f992-471d-476a-9965-d8876728633b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:34.166024 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9a53f992-471d-476a-9965-d8876728633b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:34.166821 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9a53f992-471d-476a-9965-d8876728633b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:34.325330 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d1618d46-fae7-4f1f-8660-67d8e560850e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:34.333400 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d1618d46-fae7-4f1f-8660-67d8e560850e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:34.335268 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d1618d46-fae7-4f1f-8660-67d8e560850e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:34.336480 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d1618d46-fae7-4f1f-8660-67d8e560850e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.251441 Nov 23 07:45:34.347939 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 193/404] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:34 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:34.364456 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-9a53f992-471d-476a-9965-d8876728633b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:34.365251 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-4d27aec5-dcd1-45ad-9ab3-58507291dcec tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:34.365967 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-4d27aec5-dcd1-45ad-9ab3-58507291dcec tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:34.384572 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-9a53f992-471d-476a-9965-d8876728633b tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1314 microversion: 2.1 time: 0.247086 Nov 23 07:45:34.388103 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 212/405] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:34 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:34.393330 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8d1d5e73-177d-4ebb-b17d-38dea06f3b41 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:34.394452 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8d1d5e73-177d-4ebb-b17d-38dea06f3b41 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:34.400405 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4d27aec5-dcd1-45ad-9ab3-58507291dcec tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:34.400970 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4d27aec5-dcd1-45ad-9ab3-58507291dcec tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:34.401982 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4d27aec5-dcd1-45ad-9ab3-58507291dcec tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:34.402525 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4d27aec5-dcd1-45ad-9ab3-58507291dcec tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:34.411033 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8d1d5e73-177d-4ebb-b17d-38dea06f3b41 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:34.411494 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8d1d5e73-177d-4ebb-b17d-38dea06f3b41 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:34.412304 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8d1d5e73-177d-4ebb-b17d-38dea06f3b41 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:34.412752 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8d1d5e73-177d-4ebb-b17d-38dea06f3b41 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:34.584029 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-4d27aec5-dcd1-45ad-9ab3-58507291dcec tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:34.590961 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-8d1d5e73-177d-4ebb-b17d-38dea06f3b41 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:34.592718 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-4d27aec5-dcd1-45ad-9ab3-58507291dcec tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1358 microversion: 2.1 time: 0.231451 Nov 23 07:45:34.599983 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 194/406] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:34 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:34.605657 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-8d1d5e73-177d-4ebb-b17d-38dea06f3b41 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1724 microversion: 2.1 time: 0.215943 Nov 23 07:45:34.606343 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 213/407] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:34 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:35.355686 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-2f9232fd-2e2e-4ef5-975c-4112a1dd7c79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:35.356999 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-2f9232fd-2e2e-4ef5-975c-4112a1dd7c79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:35.363613 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2f9232fd-2e2e-4ef5-975c-4112a1dd7c79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:35.364068 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2f9232fd-2e2e-4ef5-975c-4112a1dd7c79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:35.364872 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2f9232fd-2e2e-4ef5-975c-4112a1dd7c79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:35.365298 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2f9232fd-2e2e-4ef5-975c-4112a1dd7c79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:35.405259 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b09173e6-ece7-4ebc-9d61-554d345947a5 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:35.407176 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-b09173e6-ece7-4ebc-9d61-554d345947a5 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:35.415561 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b09173e6-ece7-4ebc-9d61-554d345947a5 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:35.415561 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b09173e6-ece7-4ebc-9d61-554d345947a5 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:35.416766 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b09173e6-ece7-4ebc-9d61-554d345947a5 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:35.417511 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b09173e6-ece7-4ebc-9d61-554d345947a5 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:35.578854 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-2f9232fd-2e2e-4ef5-975c-4112a1dd7c79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:35.596056 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-2f9232fd-2e2e-4ef5-975c-4112a1dd7c79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:35.597787 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-2f9232fd-2e2e-4ef5-975c-4112a1dd7c79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:35.599373 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-2f9232fd-2e2e-4ef5-975c-4112a1dd7c79 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.247513 Nov 23 07:45:35.599995 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 195/408] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:35 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:35.612590 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b09173e6-ece7-4ebc-9d61-554d345947a5 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:35.621174 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-141097e0-292b-442a-968d-1139ef6079c1 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:35.621493 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b09173e6-ece7-4ebc-9d61-554d345947a5 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1314 microversion: 2.1 time: 0.219814 Nov 23 07:45:35.622241 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-141097e0-292b-442a-968d-1139ef6079c1 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:35.629504 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-141097e0-292b-442a-968d-1139ef6079c1 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:35.630468 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-141097e0-292b-442a-968d-1139ef6079c1 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:35.631731 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-141097e0-292b-442a-968d-1139ef6079c1 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:35.632275 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 214/409] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:35 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:35.632821 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-141097e0-292b-442a-968d-1139ef6079c1 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:35.638813 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b98922d6-1d81-4e1d-81cc-d87c0927a206 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:35.639529 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-b98922d6-1d81-4e1d-81cc-d87c0927a206 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:35.645869 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b98922d6-1d81-4e1d-81cc-d87c0927a206 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:35.646315 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b98922d6-1d81-4e1d-81cc-d87c0927a206 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:35.647115 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b98922d6-1d81-4e1d-81cc-d87c0927a206 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:35.647541 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b98922d6-1d81-4e1d-81cc-d87c0927a206 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:35.809335 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-141097e0-292b-442a-968d-1139ef6079c1 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:35.816924 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-141097e0-292b-442a-968d-1139ef6079c1 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1358 microversion: 2.1 time: 0.203467 Nov 23 07:45:35.817520 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 196/410] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:35 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:35.837247 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b98922d6-1d81-4e1d-81cc-d87c0927a206 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:35.845385 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b98922d6-1d81-4e1d-81cc-d87c0927a206 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1724 microversion: 2.1 time: 0.211797 Nov 23 07:45:35.846016 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 215/411] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:35 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:36.619609 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-bf9b5120-6857-450d-84af-86cb24ddda2c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:36.620269 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-bf9b5120-6857-450d-84af-86cb24ddda2c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:36.626825 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bf9b5120-6857-450d-84af-86cb24ddda2c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:36.627274 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bf9b5120-6857-450d-84af-86cb24ddda2c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:36.628119 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bf9b5120-6857-450d-84af-86cb24ddda2c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:36.628466 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bf9b5120-6857-450d-84af-86cb24ddda2c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:36.642112 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-989d12b8-183e-4656-b698-0ee84c2b2cd3 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:36.642112 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-989d12b8-183e-4656-b698-0ee84c2b2cd3 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:36.647473 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-989d12b8-183e-4656-b698-0ee84c2b2cd3 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:36.647936 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-989d12b8-183e-4656-b698-0ee84c2b2cd3 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:36.648740 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-989d12b8-183e-4656-b698-0ee84c2b2cd3 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:36.649787 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-989d12b8-183e-4656-b698-0ee84c2b2cd3 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:36.775848 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-bf9b5120-6857-450d-84af-86cb24ddda2c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:36.784435 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-bf9b5120-6857-450d-84af-86cb24ddda2c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:36.786089 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-bf9b5120-6857-450d-84af-86cb24ddda2c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:36.787603 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-bf9b5120-6857-450d-84af-86cb24ddda2c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.171804 Nov 23 07:45:36.787898 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 197/412] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:36 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:36.798107 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-989d12b8-183e-4656-b698-0ee84c2b2cd3 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:36.805939 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-989d12b8-183e-4656-b698-0ee84c2b2cd3 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1314 microversion: 2.1 time: 0.169932 Nov 23 07:45:36.806517 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 216/413] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:36 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:36.835401 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-9059e6ec-839a-4072-96fa-58bb0075dbd5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:36.836160 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-9059e6ec-839a-4072-96fa-58bb0075dbd5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:36.843800 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9059e6ec-839a-4072-96fa-58bb0075dbd5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:36.844424 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9059e6ec-839a-4072-96fa-58bb0075dbd5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:36.845331 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9059e6ec-839a-4072-96fa-58bb0075dbd5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:36.846069 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9059e6ec-839a-4072-96fa-58bb0075dbd5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:36.865952 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-44e1cc8f-1e4b-4a1f-8c89-1d84c75a9bef tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:36.866686 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-44e1cc8f-1e4b-4a1f-8c89-1d84c75a9bef tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:36.874775 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-44e1cc8f-1e4b-4a1f-8c89-1d84c75a9bef tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:36.875427 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-44e1cc8f-1e4b-4a1f-8c89-1d84c75a9bef tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:36.876415 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-44e1cc8f-1e4b-4a1f-8c89-1d84c75a9bef tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:36.876932 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-44e1cc8f-1e4b-4a1f-8c89-1d84c75a9bef tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:36.995875 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-9059e6ec-839a-4072-96fa-58bb0075dbd5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:37.003359 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-9059e6ec-839a-4072-96fa-58bb0075dbd5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1358 microversion: 2.1 time: 0.172037 Nov 23 07:45:37.003945 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 198/414] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:36 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:37.040366 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-44e1cc8f-1e4b-4a1f-8c89-1d84c75a9bef tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:37.048154 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-44e1cc8f-1e4b-4a1f-8c89-1d84c75a9bef tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1724 microversion: 2.1 time: 0.187138 Nov 23 07:45:37.048720 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 217/415] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:36 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:37.811863 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-aeae4f13-ac83-427a-b05c-20dc16dca030 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:37.813337 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-aeae4f13-ac83-427a-b05c-20dc16dca030 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:37.824104 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aeae4f13-ac83-427a-b05c-20dc16dca030 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:37.824856 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aeae4f13-ac83-427a-b05c-20dc16dca030 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:37.825958 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aeae4f13-ac83-427a-b05c-20dc16dca030 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:37.827229 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aeae4f13-ac83-427a-b05c-20dc16dca030 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:37.829016 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-067d07b7-c2dc-40b8-bb5e-67b9050e1244 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:37.830950 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-067d07b7-c2dc-40b8-bb5e-67b9050e1244 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:37.841922 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-067d07b7-c2dc-40b8-bb5e-67b9050e1244 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:37.843378 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-067d07b7-c2dc-40b8-bb5e-67b9050e1244 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:37.844639 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-067d07b7-c2dc-40b8-bb5e-67b9050e1244 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:37.845482 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-067d07b7-c2dc-40b8-bb5e-67b9050e1244 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:38.010624 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-067d07b7-c2dc-40b8-bb5e-67b9050e1244 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:38.019833 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-067d07b7-c2dc-40b8-bb5e-67b9050e1244 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1314 microversion: 2.1 time: 0.199423 Nov 23 07:45:38.020534 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 218/416] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:37 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:38.025222 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e1418d40-305e-4382-bfa0-37972325676d tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:38.025953 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e1418d40-305e-4382-bfa0-37972325676d tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:38.032793 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e1418d40-305e-4382-bfa0-37972325676d tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:38.033247 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e1418d40-305e-4382-bfa0-37972325676d tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:38.034558 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e1418d40-305e-4382-bfa0-37972325676d tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:38.035124 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e1418d40-305e-4382-bfa0-37972325676d tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:38.088775 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-aeae4f13-ac83-427a-b05c-20dc16dca030 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:38.099019 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-aeae4f13-ac83-427a-b05c-20dc16dca030 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:38.100935 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-aeae4f13-ac83-427a-b05c-20dc16dca030 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:38.104067 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-aeae4f13-ac83-427a-b05c-20dc16dca030 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.300403 Nov 23 07:45:38.105795 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 199/417] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:37 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:38.111325 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-1a34f591-81a7-4131-901c-4b3cf0027197 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:38.112340 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-1a34f591-81a7-4131-901c-4b3cf0027197 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:38.120005 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1a34f591-81a7-4131-901c-4b3cf0027197 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:38.120618 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1a34f591-81a7-4131-901c-4b3cf0027197 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:38.122012 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1a34f591-81a7-4131-901c-4b3cf0027197 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:38.122585 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1a34f591-81a7-4131-901c-4b3cf0027197 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:38.213361 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-e1418d40-305e-4382-bfa0-37972325676d tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:38.226555 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e1418d40-305e-4382-bfa0-37972325676d tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1358 microversion: 2.1 time: 0.204427 Nov 23 07:45:38.228185 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 219/418] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:38 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:38.391050 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-1a34f591-81a7-4131-901c-4b3cf0027197 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:38.408078 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-1a34f591-81a7-4131-901c-4b3cf0027197 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1701 microversion: 2.1 time: 0.300380 Nov 23 07:45:38.408786 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 200/419] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:38 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1701 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:38.427806 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-470a828c-96a6-413f-b50f-8028bf94be4b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:38.434984 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-470a828c-96a6-413f-b50f-8028bf94be4b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:38.435411 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-470a828c-96a6-413f-b50f-8028bf94be4b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:38.445339 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-7ad266da-3469-4b53-bfc0-248ca5c9619b req-99567208-1a51-4433-96f0-3db8055bbd6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "842f1da9-1085-4946-b62b-9ae2c5ad009b", "tag": "46440f82-0a6b-4d97-82a5-b146d1263ea9"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:38.447092 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:45:38.447092 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:45:38.464542 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-7ad266da-3469-4b53-bfc0-248ca5c9619b req-99567208-1a51-4433-96f0-3db8055bbd6d service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:38.465036 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-7ad266da-3469-4b53-bfc0-248ca5c9619b req-99567208-1a51-4433-96f0-3db8055bbd6d service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:38.492791 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-470a828c-96a6-413f-b50f-8028bf94be4b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Going to try to start instance {{(pid=122786) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 23 07:45:38.495223 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-7ad266da-3469-4b53-bfc0-248ca5c9619b req-99567208-1a51-4433-96f0-3db8055bbd6d service nova] Creating event network-changed:46440f82-0a6b-4d97-82a5-b146d1263ea9 for instance 842f1da9-1085-4946-b62b-9ae2c5ad009b on hv-cinder-80403 Nov 23 07:45:38.504386 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-7ad266da-3469-4b53-bfc0-248ca5c9619b req-99567208-1a51-4433-96f0-3db8055bbd6d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062766 Nov 23 07:45:38.505760 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 201/420] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:45:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:45:38.555844 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-470a828c-96a6-413f-b50f-8028bf94be4b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 202 len: 0 microversion: 2.1 time: 0.132626 Nov 23 07:45:38.556659 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 220/421] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:45:38 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:45:38.565024 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-6bda10a8-1373-491b-901a-269449c083f3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:38.565865 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-6bda10a8-1373-491b-901a-269449c083f3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:38.573382 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6bda10a8-1373-491b-901a-269449c083f3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:38.574124 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6bda10a8-1373-491b-901a-269449c083f3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:38.575466 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6bda10a8-1373-491b-901a-269449c083f3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:38.576207 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6bda10a8-1373-491b-901a-269449c083f3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:38.743790 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-345dd5d1-87a8-493e-903f-0cc410456c06 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:38.745135 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-345dd5d1-87a8-493e-903f-0cc410456c06 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:38.752303 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-345dd5d1-87a8-493e-903f-0cc410456c06 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:38.752684 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-345dd5d1-87a8-493e-903f-0cc410456c06 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:38.753583 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-345dd5d1-87a8-493e-903f-0cc410456c06 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:38.753985 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-345dd5d1-87a8-493e-903f-0cc410456c06 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:38.792590 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.objects.instance [None req-345dd5d1-87a8-493e-903f-0cc410456c06 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lazy-loading 'flavor' on Instance uuid c5cba5f7-c9fd-4708-923c-deec6ab27cdd {{(pid=122786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:45:38.795945 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-6bda10a8-1373-491b-901a-269449c083f3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:38.807319 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-6bda10a8-1373-491b-901a-269449c083f3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1710 microversion: 2.1 time: 0.246180 Nov 23 07:45:38.808392 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 202/422] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:38 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1710 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:38.974888 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-345dd5d1-87a8-493e-903f-0cc410456c06 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "POST /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/action" status: 200 len: 32 microversion: 2.1 time: 0.237190 Nov 23 07:45:38.975642 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 221/423] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:45:38 2021] POST /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/action => generated 32 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 07:45:38.991243 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-23af2a19-cbd6-4a65-8d9a-cf2651c34b9e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:38.994927 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-23af2a19-cbd6-4a65-8d9a-cf2651c34b9e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:39.006895 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-23af2a19-cbd6-4a65-8d9a-cf2651c34b9e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:39.007678 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-23af2a19-cbd6-4a65-8d9a-cf2651c34b9e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:39.009357 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-23af2a19-cbd6-4a65-8d9a-cf2651c34b9e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:39.010134 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-23af2a19-cbd6-4a65-8d9a-cf2651c34b9e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:39.037560 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-af071363-de8c-4bdd-a29b-85a1f61c9359 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:39.038320 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-af071363-de8c-4bdd-a29b-85a1f61c9359 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:39.046673 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-af071363-de8c-4bdd-a29b-85a1f61c9359 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:39.047401 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-af071363-de8c-4bdd-a29b-85a1f61c9359 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:39.048224 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-af071363-de8c-4bdd-a29b-85a1f61c9359 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:39.048665 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-af071363-de8c-4bdd-a29b-85a1f61c9359 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:39.201854 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-af071363-de8c-4bdd-a29b-85a1f61c9359 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:39.209872 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-af071363-de8c-4bdd-a29b-85a1f61c9359 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1314 microversion: 2.1 time: 0.177356 Nov 23 07:45:39.210473 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 222/424] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:39 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:39.215865 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1b9c4f44-0d66-40fb-b7a2-d3a423a7080d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:39.216544 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1b9c4f44-0d66-40fb-b7a2-d3a423a7080d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:39.223730 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1b9c4f44-0d66-40fb-b7a2-d3a423a7080d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:39.224205 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1b9c4f44-0d66-40fb-b7a2-d3a423a7080d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:39.225017 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1b9c4f44-0d66-40fb-b7a2-d3a423a7080d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:39.225452 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1b9c4f44-0d66-40fb-b7a2-d3a423a7080d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:39.377992 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1b9c4f44-0d66-40fb-b7a2-d3a423a7080d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:39.386123 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1b9c4f44-0d66-40fb-b7a2-d3a423a7080d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:39.387640 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1b9c4f44-0d66-40fb-b7a2-d3a423a7080d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:39.388821 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1b9c4f44-0d66-40fb-b7a2-d3a423a7080d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1742 microversion: 2.20 time: 0.177418 Nov 23 07:45:39.389381 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 223/425] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:39 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1742 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:39.393873 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-7b07c51c-960d-481e-bbd6-b9a2cefa469c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:39.394406 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-7b07c51c-960d-481e-bbd6-b9a2cefa469c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:39.402536 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7b07c51c-960d-481e-bbd6-b9a2cefa469c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:39.402994 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7b07c51c-960d-481e-bbd6-b9a2cefa469c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:39.403790 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7b07c51c-960d-481e-bbd6-b9a2cefa469c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:39.404216 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7b07c51c-960d-481e-bbd6-b9a2cefa469c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:39.782259 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-7b07c51c-960d-481e-bbd6-b9a2cefa469c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:39.786318 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-23af2a19-cbd6-4a65-8d9a-cf2651c34b9e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:39.794501 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-7b07c51c-960d-481e-bbd6-b9a2cefa469c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1358 microversion: 2.1 time: 0.403995 Nov 23 07:45:39.795304 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 224/426] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:39 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1358 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:39.807282 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-23af2a19-cbd6-4a65-8d9a-cf2651c34b9e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.824488 Nov 23 07:45:39.808720 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 203/427] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:38 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:39.825350 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4cbda629-8733-4082-abba-bacc19aa0524 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:39.825693 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4cbda629-8733-4082-abba-bacc19aa0524 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:39.832792 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4cbda629-8733-4082-abba-bacc19aa0524 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:39.833976 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4cbda629-8733-4082-abba-bacc19aa0524 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:39.834857 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4cbda629-8733-4082-abba-bacc19aa0524 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:39.835357 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4cbda629-8733-4082-abba-bacc19aa0524 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:40.044991 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-4cbda629-8733-4082-abba-bacc19aa0524 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:40.065369 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4cbda629-8733-4082-abba-bacc19aa0524 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1710 microversion: 2.1 time: 0.244437 Nov 23 07:45:40.065938 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 225/428] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:39 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1710 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:40.227561 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-88724c89-3823-414c-a75d-b9038a97bb30 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:40.228237 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-88724c89-3823-414c-a75d-b9038a97bb30 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:40.234958 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-88724c89-3823-414c-a75d-b9038a97bb30 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:40.235314 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-88724c89-3823-414c-a75d-b9038a97bb30 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:40.236334 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-88724c89-3823-414c-a75d-b9038a97bb30 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:40.236949 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-88724c89-3823-414c-a75d-b9038a97bb30 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:40.414354 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8ab8c3e2-0014-437c-a008-a96873f24ba7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:40.415664 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8ab8c3e2-0014-437c-a008-a96873f24ba7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:40.421671 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8ab8c3e2-0014-437c-a008-a96873f24ba7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:40.423790 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8ab8c3e2-0014-437c-a008-a96873f24ba7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:40.423790 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8ab8c3e2-0014-437c-a008-a96873f24ba7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:40.423790 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8ab8c3e2-0014-437c-a008-a96873f24ba7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:40.576489 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-8ab8c3e2-0014-437c-a008-a96873f24ba7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:40.584565 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-8ab8c3e2-0014-437c-a008-a96873f24ba7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:40.586105 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-8ab8c3e2-0014-437c-a008-a96873f24ba7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:40.587854 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-8ab8c3e2-0014-437c-a008-a96873f24ba7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1742 microversion: 2.20 time: 0.178292 Nov 23 07:45:40.588412 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 226/429] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:40 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1742 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:45:40.593098 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-58b2e9c2-b87a-4f0f-a69e-5c2d50d757a2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2cd0bb1-42f8-4255-aefd-c05b9367ae70", "device": "/dev/sdb"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:40.594768 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-58b2e9c2-b87a-4f0f-a69e-5c2d50d757a2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:40.600755 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-58b2e9c2-b87a-4f0f-a69e-5c2d50d757a2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:40.601204 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-58b2e9c2-b87a-4f0f-a69e-5c2d50d757a2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:40.602428 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-58b2e9c2-b87a-4f0f-a69e-5c2d50d757a2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:40.602556 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-58b2e9c2-b87a-4f0f-a69e-5c2d50d757a2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:40.668793 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-88724c89-3823-414c-a75d-b9038a97bb30 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:40.678587 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-88724c89-3823-414c-a75d-b9038a97bb30 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1499 microversion: 2.1 time: 0.455727 Nov 23 07:45:40.680270 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 204/430] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:40 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1499 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:40.813082 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-337157fd-b4a8-4003-84f3-3fa83a469d88 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:40.815243 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-337157fd-b4a8-4003-84f3-3fa83a469d88 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:40.827088 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-337157fd-b4a8-4003-84f3-3fa83a469d88 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:40.827931 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-337157fd-b4a8-4003-84f3-3fa83a469d88 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:40.829658 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-337157fd-b4a8-4003-84f3-3fa83a469d88 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:40.830408 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-337157fd-b4a8-4003-84f3-3fa83a469d88 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:40.935752 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-58b2e9c2-b87a-4f0f-a69e-5c2d50d757a2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "POST /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346031 Nov 23 07:45:40.936976 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 227/431] 10.222.0.48 () {60 vars in 1322 bytes} [Tue Nov 23 07:45:40 2021] POST /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:45:40.948619 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e3f29393-fd27-4678-be74-8752db6ad0c5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:40.949791 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e3f29393-fd27-4678-be74-8752db6ad0c5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:40.962702 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e3f29393-fd27-4678-be74-8752db6ad0c5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:40.963528 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e3f29393-fd27-4678-be74-8752db6ad0c5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:40.966071 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e3f29393-fd27-4678-be74-8752db6ad0c5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:40.967101 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e3f29393-fd27-4678-be74-8752db6ad0c5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:41.166222 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-e3f29393-fd27-4678-be74-8752db6ad0c5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:41.166821 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-337157fd-b4a8-4003-84f3-3fa83a469d88 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:41.174144 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-337157fd-b4a8-4003-84f3-3fa83a469d88 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1358 microversion: 2.1 time: 0.364641 Nov 23 07:45:41.174724 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 205/432] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:40 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1358 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:41.175569 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e3f29393-fd27-4678-be74-8752db6ad0c5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.236493 Nov 23 07:45:41.179605 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-69a0dbf7-2add-4f03-9d62-384067bb8c5a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:41.180748 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-69a0dbf7-2add-4f03-9d62-384067bb8c5a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:41.185397 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 228/433] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:40 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:41.188235 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-69a0dbf7-2add-4f03-9d62-384067bb8c5a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:41.188634 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-69a0dbf7-2add-4f03-9d62-384067bb8c5a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:41.189411 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-69a0dbf7-2add-4f03-9d62-384067bb8c5a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:41.189874 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-69a0dbf7-2add-4f03-9d62-384067bb8c5a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:41.345225 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-69a0dbf7-2add-4f03-9d62-384067bb8c5a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:41.346779 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-08720ad1-ad7d-4d84-ac08-9f72fe30c348 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:41.347287 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-08720ad1-ad7d-4d84-ac08-9f72fe30c348 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:41.353755 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-08720ad1-ad7d-4d84-ac08-9f72fe30c348 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:41.354026 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-69a0dbf7-2add-4f03-9d62-384067bb8c5a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1710 microversion: 2.1 time: 0.177988 Nov 23 07:45:41.354178 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-08720ad1-ad7d-4d84-ac08-9f72fe30c348 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:41.354613 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 206/434] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:41 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1710 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:41.354966 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-08720ad1-ad7d-4d84-ac08-9f72fe30c348 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:41.355496 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-08720ad1-ad7d-4d84-ac08-9f72fe30c348 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:41.381231 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-08720ad1-ad7d-4d84-ac08-9f72fe30c348 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Going to try to terminate instance {{(pid=122786) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:45:41.474375 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-08720ad1-ad7d-4d84-ac08-9f72fe30c348 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 204 len: 0 microversion: 2.1 time: 0.130907 Nov 23 07:45:41.475191 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 229/435] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:45:41 2021] DELETE /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 07:45:41.487134 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-40b45d66-f16d-4e99-ad59-a358a13df962 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:41.488354 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-40b45d66-f16d-4e99-ad59-a358a13df962 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:41.498370 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40b45d66-f16d-4e99-ad59-a358a13df962 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:41.499079 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40b45d66-f16d-4e99-ad59-a358a13df962 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:41.500371 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40b45d66-f16d-4e99-ad59-a358a13df962 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:41.501092 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40b45d66-f16d-4e99-ad59-a358a13df962 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:41.608048 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-fe8d1930-7965-4b94-a861-723d79b3a80d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:41.609499 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-fe8d1930-7965-4b94-a861-723d79b3a80d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:41.616345 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fe8d1930-7965-4b94-a861-723d79b3a80d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:41.616805 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fe8d1930-7965-4b94-a861-723d79b3a80d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:41.618138 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fe8d1930-7965-4b94-a861-723d79b3a80d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:41.618643 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fe8d1930-7965-4b94-a861-723d79b3a80d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:41.647995 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-40b45d66-f16d-4e99-ad59-a358a13df962 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:41.655831 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-40b45d66-f16d-4e99-ad59-a358a13df962 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1505 microversion: 2.1 time: 0.174903 Nov 23 07:45:41.656389 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 207/436] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:41 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:41.762062 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-fe8d1930-7965-4b94-a861-723d79b3a80d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:41.770107 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-fe8d1930-7965-4b94-a861-723d79b3a80d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:41.771594 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-fe8d1930-7965-4b94-a861-723d79b3a80d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:41.772739 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-fe8d1930-7965-4b94-a861-723d79b3a80d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1742 microversion: 2.20 time: 0.170387 Nov 23 07:45:41.773296 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 230/437] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:41 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1742 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:42.193201 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-7aa2a700-c038-4b47-84da-976300670ed4 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:42.197515 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-dc9d2321-9044-48d2-a03d-7e157b4a9811 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:42.198163 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-dc9d2321-9044-48d2-a03d-7e157b4a9811 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:42.199872 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-7aa2a700-c038-4b47-84da-976300670ed4 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:42.207470 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-dc9d2321-9044-48d2-a03d-7e157b4a9811 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:42.207929 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-dc9d2321-9044-48d2-a03d-7e157b4a9811 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:42.208707 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7aa2a700-c038-4b47-84da-976300670ed4 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:42.208858 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-dc9d2321-9044-48d2-a03d-7e157b4a9811 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:42.209209 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-dc9d2321-9044-48d2-a03d-7e157b4a9811 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:42.210017 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7aa2a700-c038-4b47-84da-976300670ed4 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:42.210957 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7aa2a700-c038-4b47-84da-976300670ed4 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:42.212041 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7aa2a700-c038-4b47-84da-976300670ed4 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:42.371466 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-dc9d2321-9044-48d2-a03d-7e157b4a9811 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:42.379231 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-dc9d2321-9044-48d2-a03d-7e157b4a9811 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1358 microversion: 2.1 time: 0.190889 Nov 23 07:45:42.379985 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 208/438] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:42 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:42.384497 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-7aa2a700-c038-4b47-84da-976300670ed4 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:42.385884 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-62ecf153-d3bb-41d9-b02a-88aefe59c15d req-a041eafd-8999-4fe9-a614-7ef930b04177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb841a35-6344-43a0-85d2-6de8116759b1", "name": "network-vif-plugged", "status": "completed", "tag": "8b4fce4b-5f2b-4eea-8335-5d57ac70511e"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:42.387658 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:45:42.387658 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:45:42.395716 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-62ecf153-d3bb-41d9-b02a-88aefe59c15d req-a041eafd-8999-4fe9-a614-7ef930b04177 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:42.396168 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-7aa2a700-c038-4b47-84da-976300670ed4 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.206271 Nov 23 07:45:42.396587 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-62ecf153-d3bb-41d9-b02a-88aefe59c15d req-a041eafd-8999-4fe9-a614-7ef930b04177 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:42.406835 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 231/439] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:42 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:42.412952 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-fe2c141a-bdd0-4b1d-af99-928cc4c1be99 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:42.414142 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-fe2c141a-bdd0-4b1d-af99-928cc4c1be99 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:42.420379 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-62ecf153-d3bb-41d9-b02a-88aefe59c15d req-a041eafd-8999-4fe9-a614-7ef930b04177 service nova] Creating event network-vif-plugged:8b4fce4b-5f2b-4eea-8335-5d57ac70511e for instance bb841a35-6344-43a0-85d2-6de8116759b1 on hv-cinder-80403 Nov 23 07:45:42.422283 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fe2c141a-bdd0-4b1d-af99-928cc4c1be99 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:42.422823 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fe2c141a-bdd0-4b1d-af99-928cc4c1be99 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:42.423695 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fe2c141a-bdd0-4b1d-af99-928cc4c1be99 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:42.424140 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fe2c141a-bdd0-4b1d-af99-928cc4c1be99 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:42.426760 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-62ecf153-d3bb-41d9-b02a-88aefe59c15d req-a041eafd-8999-4fe9-a614-7ef930b04177 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045410 Nov 23 07:45:42.427612 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 209/440] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:45:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:45:42.565875 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-fe2c141a-bdd0-4b1d-af99-928cc4c1be99 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:42.575015 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-fe2c141a-bdd0-4b1d-af99-928cc4c1be99 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1714 microversion: 2.1 time: 0.176249 Nov 23 07:45:42.575654 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 232/441] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:42 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1714 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:42.674085 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-03f84286-eb04-4114-8bd7-73c147b696d7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:42.674770 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-03f84286-eb04-4114-8bd7-73c147b696d7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:42.681654 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-03f84286-eb04-4114-8bd7-73c147b696d7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:42.682123 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-03f84286-eb04-4114-8bd7-73c147b696d7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:42.682909 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-03f84286-eb04-4114-8bd7-73c147b696d7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:42.683365 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-03f84286-eb04-4114-8bd7-73c147b696d7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:42.793951 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a6eca4ff-c170-4c58-864a-712b4986498e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:42.794608 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a6eca4ff-c170-4c58-864a-712b4986498e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:42.801056 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a6eca4ff-c170-4c58-864a-712b4986498e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:42.801551 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a6eca4ff-c170-4c58-864a-712b4986498e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:42.802447 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a6eca4ff-c170-4c58-864a-712b4986498e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:42.802888 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a6eca4ff-c170-4c58-864a-712b4986498e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:42.846849 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-03f84286-eb04-4114-8bd7-73c147b696d7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:42.857330 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-03f84286-eb04-4114-8bd7-73c147b696d7 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1505 microversion: 2.1 time: 0.187192 Nov 23 07:45:42.858061 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 210/442] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:42 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:42.962588 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a6eca4ff-c170-4c58-864a-712b4986498e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:42.970810 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a6eca4ff-c170-4c58-864a-712b4986498e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:42.972358 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a6eca4ff-c170-4c58-864a-712b4986498e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:42.973482 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a6eca4ff-c170-4c58-864a-712b4986498e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1742 microversion: 2.20 time: 0.184872 Nov 23 07:45:42.974487 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 233/443] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:42 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1742 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:45:43.403541 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c3d2376f-5799-4beb-8f99-cfff670c9a8e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:43.404180 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c3d2376f-5799-4beb-8f99-cfff670c9a8e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:43.411052 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c3d2376f-5799-4beb-8f99-cfff670c9a8e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:43.411501 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c3d2376f-5799-4beb-8f99-cfff670c9a8e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:43.412436 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c3d2376f-5799-4beb-8f99-cfff670c9a8e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:43.412908 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c3d2376f-5799-4beb-8f99-cfff670c9a8e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:43.414898 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c78a4715-6cdd-4f8a-a3c1-3da20c5f10da tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:43.415794 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c78a4715-6cdd-4f8a-a3c1-3da20c5f10da tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:43.423822 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c78a4715-6cdd-4f8a-a3c1-3da20c5f10da tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:43.424361 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c78a4715-6cdd-4f8a-a3c1-3da20c5f10da tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:43.425344 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c78a4715-6cdd-4f8a-a3c1-3da20c5f10da tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:43.425898 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c78a4715-6cdd-4f8a-a3c1-3da20c5f10da tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:43.602653 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-c78a4715-6cdd-4f8a-a3c1-3da20c5f10da tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:43.611440 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c78a4715-6cdd-4f8a-a3c1-3da20c5f10da tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.200842 Nov 23 07:45:43.629696 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 234/444] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:43 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:43.712326 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c3d2376f-5799-4beb-8f99-cfff670c9a8e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:43.723402 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c3d2376f-5799-4beb-8f99-cfff670c9a8e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1358 microversion: 2.1 time: 0.324323 Nov 23 07:45:43.734714 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 211/445] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:43 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1358 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:43.876976 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ed2c2ac1-d050-4eda-b51e-059fb33042de tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:43.877520 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ed2c2ac1-d050-4eda-b51e-059fb33042de tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:43.888144 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ed2c2ac1-d050-4eda-b51e-059fb33042de tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:43.888605 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ed2c2ac1-d050-4eda-b51e-059fb33042de tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:43.889425 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ed2c2ac1-d050-4eda-b51e-059fb33042de tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:43.890161 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ed2c2ac1-d050-4eda-b51e-059fb33042de tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:43.995288 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-13b883f8-21df-4d50-be32-ada99b5d4c83 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:43.997246 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-13b883f8-21df-4d50-be32-ada99b5d4c83 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:44.005235 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13b883f8-21df-4d50-be32-ada99b5d4c83 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:44.006945 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13b883f8-21df-4d50-be32-ada99b5d4c83 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:44.009182 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13b883f8-21df-4d50-be32-ada99b5d4c83 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:44.011463 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13b883f8-21df-4d50-be32-ada99b5d4c83 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:44.116852 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ed2c2ac1-d050-4eda-b51e-059fb33042de tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:44.131989 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ed2c2ac1-d050-4eda-b51e-059fb33042de tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1505 microversion: 2.1 time: 0.260996 Nov 23 07:45:44.144914 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 235/446] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:43 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1505 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:44.361449 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-178a8cd3-c1f4-4397-b8d2-9d14cd58b10c req-7a697f0b-8881-447c-88ae-817fc7a2e348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd486dfc-f28a-4b35-ab29-ffe8daab8a69", "name": "network-vif-deleted", "tag": "7abf5039-2cd0-48cc-93cd-f72b7d305c16"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:44.364517 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:45:44.364517 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:45:44.380283 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-178a8cd3-c1f4-4397-b8d2-9d14cd58b10c req-7a697f0b-8881-447c-88ae-817fc7a2e348 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:44.381273 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-178a8cd3-c1f4-4397-b8d2-9d14cd58b10c req-7a697f0b-8881-447c-88ae-817fc7a2e348 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:44.395455 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-178a8cd3-c1f4-4397-b8d2-9d14cd58b10c req-7a697f0b-8881-447c-88ae-817fc7a2e348 service nova] Creating event network-vif-deleted:7abf5039-2cd0-48cc-93cd-f72b7d305c16 for instance cd486dfc-f28a-4b35-ab29-ffe8daab8a69 on hv-cinder-80403 Nov 23 07:45:44.402758 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-178a8cd3-c1f4-4397-b8d2-9d14cd58b10c req-7a697f0b-8881-447c-88ae-817fc7a2e348 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046261 Nov 23 07:45:44.404072 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 236/447] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:45:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:45:44.426845 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-13b883f8-21df-4d50-be32-ada99b5d4c83 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:44.437010 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-13b883f8-21df-4d50-be32-ada99b5d4c83 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:44.443027 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-8cd86496-06fb-4cef-b89a-fb18460191e6 req-edb23131-7820-41fa-8088-0fe33cacea44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "842f1da9-1085-4946-b62b-9ae2c5ad009b", "name": "network-vif-plugged", "status": "completed", "tag": "46440f82-0a6b-4d97-82a5-b146d1263ea9"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:44.444513 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:45:44.444513 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:45:44.447602 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-13b883f8-21df-4d50-be32-ada99b5d4c83 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:44.448818 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-13b883f8-21df-4d50-be32-ada99b5d4c83 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1737 microversion: 2.20 time: 0.460118 Nov 23 07:45:44.449377 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 212/448] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:43 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1737 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:44.459915 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-8cd86496-06fb-4cef-b89a-fb18460191e6 req-edb23131-7820-41fa-8088-0fe33cacea44 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:44.460063 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-8cd86496-06fb-4cef-b89a-fb18460191e6 req-edb23131-7820-41fa-8088-0fe33cacea44 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:44.473381 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-8cd86496-06fb-4cef-b89a-fb18460191e6 req-edb23131-7820-41fa-8088-0fe33cacea44 service nova] Creating event network-vif-plugged:46440f82-0a6b-4d97-82a5-b146d1263ea9 for instance 842f1da9-1085-4946-b62b-9ae2c5ad009b on hv-cinder-80403 Nov 23 07:45:44.478302 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-8cd86496-06fb-4cef-b89a-fb18460191e6 req-edb23131-7820-41fa-8088-0fe33cacea44 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039136 Nov 23 07:45:44.479218 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 237/449] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:45:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:45:44.640489 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-fb462021-2352-40f6-8dc4-48e42b90bb39 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:44.640489 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-fb462021-2352-40f6-8dc4-48e42b90bb39 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:44.645751 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fb462021-2352-40f6-8dc4-48e42b90bb39 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:44.646475 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fb462021-2352-40f6-8dc4-48e42b90bb39 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:44.647439 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fb462021-2352-40f6-8dc4-48e42b90bb39 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:44.648033 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fb462021-2352-40f6-8dc4-48e42b90bb39 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:44.745363 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ea78c650-4cf7-44cc-b98f-bc40da708514 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:44.746588 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ea78c650-4cf7-44cc-b98f-bc40da708514 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:44.754358 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea78c650-4cf7-44cc-b98f-bc40da708514 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:44.755094 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea78c650-4cf7-44cc-b98f-bc40da708514 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:44.756798 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea78c650-4cf7-44cc-b98f-bc40da708514 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:44.757408 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea78c650-4cf7-44cc-b98f-bc40da708514 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:44.890339 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-fb462021-2352-40f6-8dc4-48e42b90bb39 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:44.906625 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-fb462021-2352-40f6-8dc4-48e42b90bb39 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.273841 Nov 23 07:45:44.909271 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 213/450] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:44 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:45.031931 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ea78c650-4cf7-44cc-b98f-bc40da708514 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:45.043595 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ea78c650-4cf7-44cc-b98f-bc40da708514 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1358 microversion: 2.1 time: 0.303822 Nov 23 07:45:45.044429 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 238/451] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:44 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1358 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:45.150431 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-4601f07c-fdc6-43d5-ab68-6aeef437d711 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:45.151378 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-4601f07c-fdc6-43d5-ab68-6aeef437d711 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:45.174001 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4601f07c-fdc6-43d5-ab68-6aeef437d711 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:45.174001 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4601f07c-fdc6-43d5-ab68-6aeef437d711 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:45.174001 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4601f07c-fdc6-43d5-ab68-6aeef437d711 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:45.174001 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4601f07c-fdc6-43d5-ab68-6aeef437d711 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:45.223590 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4601f07c-fdc6-43d5-ab68-6aeef437d711 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:45.224042 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4601f07c-fdc6-43d5-ab68-6aeef437d711 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:45.224497 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.objects.instance [None req-4601f07c-fdc6-43d5-ab68-6aeef437d711 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lazy-loading 'fault' on Instance uuid cd486dfc-f28a-4b35-ab29-ffe8daab8a69 {{(pid=122785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:45:45.290900 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-4601f07c-fdc6-43d5-ab68-6aeef437d711 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f602e0688ca74408a1de8431ceb40649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9142ed0ac74c31a3d2b005076861fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:45.304356 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-4601f07c-fdc6-43d5-ab68-6aeef437d711 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 200 len: 1304 microversion: 2.1 time: 0.157560 Nov 23 07:45:45.314859 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 214/452] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:45 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 1304 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:45.467873 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-5d5d2111-dff0-45da-ae48-835db4274636 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:45.468502 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-5d5d2111-dff0-45da-ae48-835db4274636 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:45.478579 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5d5d2111-dff0-45da-ae48-835db4274636 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:45.479117 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5d5d2111-dff0-45da-ae48-835db4274636 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:45.480033 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5d5d2111-dff0-45da-ae48-835db4274636 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:45.480678 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5d5d2111-dff0-45da-ae48-835db4274636 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:45.657027 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5d5d2111-dff0-45da-ae48-835db4274636 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:45.672237 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5d5d2111-dff0-45da-ae48-835db4274636 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:45.673976 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5d5d2111-dff0-45da-ae48-835db4274636 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:45.675190 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-5d5d2111-dff0-45da-ae48-835db4274636 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1737 microversion: 2.20 time: 0.211058 Nov 23 07:45:45.675741 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 239/453] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:45 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:45.926657 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-24b05d9e-6334-4bf1-8276-8005dea7b6fb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:45.927237 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-24b05d9e-6334-4bf1-8276-8005dea7b6fb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:45.935076 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-24b05d9e-6334-4bf1-8276-8005dea7b6fb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:45.935653 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-24b05d9e-6334-4bf1-8276-8005dea7b6fb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:45.936436 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-24b05d9e-6334-4bf1-8276-8005dea7b6fb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:45.936863 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-24b05d9e-6334-4bf1-8276-8005dea7b6fb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:46.061222 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-0eaae3d2-c1f5-419c-b806-5c2d4931d3f2 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:46.062150 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-0eaae3d2-c1f5-419c-b806-5c2d4931d3f2 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:46.074490 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0eaae3d2-c1f5-419c-b806-5c2d4931d3f2 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:46.075099 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0eaae3d2-c1f5-419c-b806-5c2d4931d3f2 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:46.076117 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0eaae3d2-c1f5-419c-b806-5c2d4931d3f2 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:46.077689 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0eaae3d2-c1f5-419c-b806-5c2d4931d3f2 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:46.110659 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-24b05d9e-6334-4bf1-8276-8005dea7b6fb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:46.133847 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-24b05d9e-6334-4bf1-8276-8005dea7b6fb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.210913 Nov 23 07:45:46.136291 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 215/454] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:45 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:46.238333 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-0eaae3d2-c1f5-419c-b806-5c2d4931d3f2 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:46.250474 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-0eaae3d2-c1f5-419c-b806-5c2d4931d3f2 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1358 microversion: 2.1 time: 0.193176 Nov 23 07:45:46.252338 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 240/455] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:46 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:46.322598 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-9476d2a0-5760-4c3e-82be-f5dad8baede4 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:46.323536 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-9476d2a0-5760-4c3e-82be-f5dad8baede4 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] [instance: cd486dfc-f28a-4b35-ab29-ffe8daab8a69] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:46.330170 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9476d2a0-5760-4c3e-82be-f5dad8baede4 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:46.330608 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9476d2a0-5760-4c3e-82be-f5dad8baede4 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:46.331556 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9476d2a0-5760-4c3e-82be-f5dad8baede4 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:46.331910 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9476d2a0-5760-4c3e-82be-f5dad8baede4 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:46.348804 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-9476d2a0-5760-4c3e-82be-f5dad8baede4 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] HTTP exception thrown: Instance cd486dfc-f28a-4b35-ab29-ffe8daab8a69 could not be found. Nov 23 07:45:46.349404 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-9476d2a0-5760-4c3e-82be-f5dad8baede4 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] Returning 404 to user: Instance cd486dfc-f28a-4b35-ab29-ffe8daab8a69 could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:45:46.350276 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-9476d2a0-5760-4c3e-82be-f5dad8baede4 tempest-VolumesActionsTest-1917704080 tempest-VolumesActionsTest-1917704080-project] 10.222.0.48 "GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69" status: 404 len: 111 microversion: 2.1 time: 0.031788 Nov 23 07:45:46.367530 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 216/456] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:46 2021] GET /compute/v2.1/servers/cd486dfc-f28a-4b35-ab29-ffe8daab8a69 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:45:46.693763 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-55819848-4082-46ef-b6bf-d0d99deba90c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:46.694550 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-55819848-4082-46ef-b6bf-d0d99deba90c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:46.701777 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-55819848-4082-46ef-b6bf-d0d99deba90c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:46.702481 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-55819848-4082-46ef-b6bf-d0d99deba90c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:46.703486 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-55819848-4082-46ef-b6bf-d0d99deba90c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:46.704126 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-55819848-4082-46ef-b6bf-d0d99deba90c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:46.906721 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-55819848-4082-46ef-b6bf-d0d99deba90c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:46.916139 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-55819848-4082-46ef-b6bf-d0d99deba90c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:46.918918 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-55819848-4082-46ef-b6bf-d0d99deba90c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:46.920570 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-55819848-4082-46ef-b6bf-d0d99deba90c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1737 microversion: 2.20 time: 0.230874 Nov 23 07:45:46.921297 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 241/457] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:46 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1737 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:47.150683 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-230459cb-8259-4ab4-85a6-430474bdb67c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:47.151353 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-230459cb-8259-4ab4-85a6-430474bdb67c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:47.158760 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-230459cb-8259-4ab4-85a6-430474bdb67c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:47.159303 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-230459cb-8259-4ab4-85a6-430474bdb67c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:47.160174 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-230459cb-8259-4ab4-85a6-430474bdb67c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:47.160679 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-230459cb-8259-4ab4-85a6-430474bdb67c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:47.271460 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-24cf55a6-abc3-4064-b70f-7c0c2df45d1f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:47.272729 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-24cf55a6-abc3-4064-b70f-7c0c2df45d1f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:47.285342 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-24cf55a6-abc3-4064-b70f-7c0c2df45d1f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:47.287505 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-24cf55a6-abc3-4064-b70f-7c0c2df45d1f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:47.296926 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-24cf55a6-abc3-4064-b70f-7c0c2df45d1f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:47.297716 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-24cf55a6-abc3-4064-b70f-7c0c2df45d1f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:47.351563 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-230459cb-8259-4ab4-85a6-430474bdb67c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:47.361035 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-230459cb-8259-4ab4-85a6-430474bdb67c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.213973 Nov 23 07:45:47.371426 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 217/458] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:47 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:47.480058 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-24cf55a6-abc3-4064-b70f-7c0c2df45d1f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:47.490393 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-24cf55a6-abc3-4064-b70f-7c0c2df45d1f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1547 microversion: 2.1 time: 0.226605 Nov 23 07:45:47.491925 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 242/459] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:47 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1547 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:47.515017 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-832ec0b8-adaf-4902-82c3-6055fa7ee8a5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:47.524326 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-832ec0b8-adaf-4902-82c3-6055fa7ee8a5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:47.531777 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-832ec0b8-adaf-4902-82c3-6055fa7ee8a5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:47.532227 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-832ec0b8-adaf-4902-82c3-6055fa7ee8a5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:47.533019 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-832ec0b8-adaf-4902-82c3-6055fa7ee8a5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:47.533452 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-832ec0b8-adaf-4902-82c3-6055fa7ee8a5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:47.690172 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-832ec0b8-adaf-4902-82c3-6055fa7ee8a5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:47.699070 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-832ec0b8-adaf-4902-82c3-6055fa7ee8a5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1547 microversion: 2.1 time: 0.187749 Nov 23 07:45:47.709833 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 218/460] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:47 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1547 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:47.721405 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6f7e829d-c801-4218-95bc-7d11db5c32fb tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:47.726230 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:45:47.726230 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:45:47.729166 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6f7e829d-c801-4218-95bc-7d11db5c32fb tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:47.730597 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6f7e829d-c801-4218-95bc-7d11db5c32fb tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Searching by: {'deleted': False, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0'} {{(pid=122786) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 23 07:45:47.739024 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6f7e829d-c801-4218-95bc-7d11db5c32fb tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:47.739562 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6f7e829d-c801-4218-95bc-7d11db5c32fb tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:47.740431 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6f7e829d-c801-4218-95bc-7d11db5c32fb tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:47.740954 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6f7e829d-c801-4218-95bc-7d11db5c32fb tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:47.840084 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.multi_cell_list [None req-6f7e829d-c801-4218-95bc-7d11db5c32fb tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122786) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 23 07:45:47.939351 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6f7e829d-c801-4218-95bc-7d11db5c32fb tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.221559 Nov 23 07:45:47.945323 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 243/461] 10.222.0.48 () {58 vars in 1124 bytes} [Tue Nov 23 07:45:47 2021] GET /compute/v2.1/servers => generated 343 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:45:47.946240 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-b7451d4b-b44a-4786-9b66-bb40b04f5bcd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:47.946849 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-b7451d4b-b44a-4786-9b66-bb40b04f5bcd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:47.952922 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-f0250239-52cc-426f-8e7f-95664b597bee tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:47.953885 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f0250239-52cc-426f-8e7f-95664b597bee tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:47.956479 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b7451d4b-b44a-4786-9b66-bb40b04f5bcd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:47.957015 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b7451d4b-b44a-4786-9b66-bb40b04f5bcd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:47.958953 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b7451d4b-b44a-4786-9b66-bb40b04f5bcd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:47.959389 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b7451d4b-b44a-4786-9b66-bb40b04f5bcd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:47.962356 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f0250239-52cc-426f-8e7f-95664b597bee tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:47.962860 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f0250239-52cc-426f-8e7f-95664b597bee tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:47.963968 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f0250239-52cc-426f-8e7f-95664b597bee tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:47.964512 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f0250239-52cc-426f-8e7f-95664b597bee tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:48.143344 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-f0250239-52cc-426f-8e7f-95664b597bee tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:48.144864 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-b7451d4b-b44a-4786-9b66-bb40b04f5bcd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:48.153939 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-f0250239-52cc-426f-8e7f-95664b597bee tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1547 microversion: 2.1 time: 0.205641 Nov 23 07:45:48.155034 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-b7451d4b-b44a-4786-9b66-bb40b04f5bcd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:48.157136 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-b7451d4b-b44a-4786-9b66-bb40b04f5bcd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:48.158620 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-b7451d4b-b44a-4786-9b66-bb40b04f5bcd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1737 microversion: 2.20 time: 0.223171 Nov 23 07:45:48.172340 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 244/462] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:47 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1547 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:48.174340 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 219/463] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:47 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1737 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:45:48.378766 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-199b3bad-fc54-4c30-8f89-a7743da31ada tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:48.379793 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-199b3bad-fc54-4c30-8f89-a7743da31ada tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:48.386353 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-199b3bad-fc54-4c30-8f89-a7743da31ada tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:48.387176 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-199b3bad-fc54-4c30-8f89-a7743da31ada tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:48.388387 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-199b3bad-fc54-4c30-8f89-a7743da31ada tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:48.389091 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-199b3bad-fc54-4c30-8f89-a7743da31ada tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:48.544996 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-199b3bad-fc54-4c30-8f89-a7743da31ada tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:48.555826 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-199b3bad-fc54-4c30-8f89-a7743da31ada tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.180807 Nov 23 07:45:48.557745 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 245/464] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:48 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:49.180434 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-43a34c5e-762e-41ea-80f2-1badd3cf4a3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:49.181275 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-43a34c5e-762e-41ea-80f2-1badd3cf4a3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:49.188902 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-43a34c5e-762e-41ea-80f2-1badd3cf4a3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:49.189352 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-43a34c5e-762e-41ea-80f2-1badd3cf4a3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:49.190181 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-43a34c5e-762e-41ea-80f2-1badd3cf4a3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:49.190808 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-43a34c5e-762e-41ea-80f2-1badd3cf4a3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:49.347467 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-43a34c5e-762e-41ea-80f2-1badd3cf4a3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:49.357183 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-43a34c5e-762e-41ea-80f2-1badd3cf4a3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:49.358912 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-43a34c5e-762e-41ea-80f2-1badd3cf4a3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:49.360187 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-43a34c5e-762e-41ea-80f2-1badd3cf4a3c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1737 microversion: 2.20 time: 0.184011 Nov 23 07:45:49.360841 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 220/465] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:49 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:49.579115 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8cb44afe-ea38-442b-8055-c302b7e6141a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:49.579949 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8cb44afe-ea38-442b-8055-c302b7e6141a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:49.594368 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8cb44afe-ea38-442b-8055-c302b7e6141a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:49.597113 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8cb44afe-ea38-442b-8055-c302b7e6141a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:49.598125 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8cb44afe-ea38-442b-8055-c302b7e6141a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:49.598688 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8cb44afe-ea38-442b-8055-c302b7e6141a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:49.772101 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-8cb44afe-ea38-442b-8055-c302b7e6141a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:49.786396 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-8cb44afe-ea38-442b-8055-c302b7e6141a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.214037 Nov 23 07:45:49.787035 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 246/466] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:49 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:50.378625 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3e88153c-129e-4e62-bb06-03fd1fdabe82 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:50.379214 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3e88153c-129e-4e62-bb06-03fd1fdabe82 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:50.387295 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3e88153c-129e-4e62-bb06-03fd1fdabe82 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:50.388080 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3e88153c-129e-4e62-bb06-03fd1fdabe82 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:50.389089 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3e88153c-129e-4e62-bb06-03fd1fdabe82 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:50.389523 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3e88153c-129e-4e62-bb06-03fd1fdabe82 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:50.545836 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-3e88153c-129e-4e62-bb06-03fd1fdabe82 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:50.556659 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-3e88153c-129e-4e62-bb06-03fd1fdabe82 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:50.558652 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-3e88153c-129e-4e62-bb06-03fd1fdabe82 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:50.559927 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3e88153c-129e-4e62-bb06-03fd1fdabe82 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1737 microversion: 2.20 time: 0.185166 Nov 23 07:45:50.560567 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 221/467] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:50 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:50.808840 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-bb8d8565-59ac-43ae-829d-6ca43a42e9ae tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:50.809598 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-bb8d8565-59ac-43ae-829d-6ca43a42e9ae tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:50.816895 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bb8d8565-59ac-43ae-829d-6ca43a42e9ae tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:50.817405 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bb8d8565-59ac-43ae-829d-6ca43a42e9ae tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:50.818265 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bb8d8565-59ac-43ae-829d-6ca43a42e9ae tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:50.818699 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bb8d8565-59ac-43ae-829d-6ca43a42e9ae tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:50.986974 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-bb8d8565-59ac-43ae-829d-6ca43a42e9ae tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:50.997143 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-bb8d8565-59ac-43ae-829d-6ca43a42e9ae tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.193116 Nov 23 07:45:50.997929 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 247/468] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:50 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:51.577963 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-8c79e4ee-bbf2-4895-b7ea-948c3f603cc2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:51.579201 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-8c79e4ee-bbf2-4895-b7ea-948c3f603cc2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:51.592157 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8c79e4ee-bbf2-4895-b7ea-948c3f603cc2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:51.592697 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8c79e4ee-bbf2-4895-b7ea-948c3f603cc2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:51.593604 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8c79e4ee-bbf2-4895-b7ea-948c3f603cc2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:51.594148 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8c79e4ee-bbf2-4895-b7ea-948c3f603cc2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:51.775694 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-8c79e4ee-bbf2-4895-b7ea-948c3f603cc2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:51.784680 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-8c79e4ee-bbf2-4895-b7ea-948c3f603cc2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:51.787088 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-8c79e4ee-bbf2-4895-b7ea-948c3f603cc2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:51.788844 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-8c79e4ee-bbf2-4895-b7ea-948c3f603cc2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1737 microversion: 2.20 time: 0.214381 Nov 23 07:45:51.789776 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 222/469] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:51 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:52.014602 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-5eedfb9d-4a1d-430d-8484-b1a5aa52a718 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:52.015254 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-5eedfb9d-4a1d-430d-8484-b1a5aa52a718 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:52.029919 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5eedfb9d-4a1d-430d-8484-b1a5aa52a718 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:52.030875 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5eedfb9d-4a1d-430d-8484-b1a5aa52a718 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:52.032150 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5eedfb9d-4a1d-430d-8484-b1a5aa52a718 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:52.032943 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5eedfb9d-4a1d-430d-8484-b1a5aa52a718 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:52.069187 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-2935cf87-398f-420b-8e38-0adb45e44e3d tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e096a1fe-8519-4b77-8d06-5e9183953b17"}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:45:52.070881 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-2935cf87-398f-420b-8e38-0adb45e44e3d tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:52.099283 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2935cf87-398f-420b-8e38-0adb45e44e3d tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:52.101691 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2935cf87-398f-420b-8e38-0adb45e44e3d tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:52.104520 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2935cf87-398f-420b-8e38-0adb45e44e3d tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:52.105543 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2935cf87-398f-420b-8e38-0adb45e44e3d tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:52.402760 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5eedfb9d-4a1d-430d-8484-b1a5aa52a718 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:52.413209 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-5eedfb9d-4a1d-430d-8484-b1a5aa52a718 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.402077 Nov 23 07:45:52.417263 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 248/470] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:52 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:52.707634 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-2935cf87-398f-420b-8e38-0adb45e44e3d tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "POST /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.643283 Nov 23 07:45:52.725207 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 223/471] 10.222.0.48 () {60 vars in 1322 bytes} [Tue Nov 23 07:45:52 2021] POST /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments => generated 194 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:45:52.807064 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-13d34113-569b-495e-b609-3975ef31d436 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:52.807681 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-13d34113-569b-495e-b609-3975ef31d436 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:52.821440 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-13d34113-569b-495e-b609-3975ef31d436 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:52.821928 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-13d34113-569b-495e-b609-3975ef31d436 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:52.823380 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-13d34113-569b-495e-b609-3975ef31d436 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:52.823823 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-13d34113-569b-495e-b609-3975ef31d436 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:53.045246 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-13d34113-569b-495e-b609-3975ef31d436 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:53.062187 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-13d34113-569b-495e-b609-3975ef31d436 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:53.063660 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-13d34113-569b-495e-b609-3975ef31d436 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:53.065018 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-13d34113-569b-495e-b609-3975ef31d436 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1737 microversion: 2.20 time: 0.262115 Nov 23 07:45:53.065760 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 249/472] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:52 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1737 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:53.436663 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-4621bce3-fa65-457c-b469-99d70c3ee845 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:53.437403 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-4621bce3-fa65-457c-b469-99d70c3ee845 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:53.444652 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4621bce3-fa65-457c-b469-99d70c3ee845 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:53.445186 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4621bce3-fa65-457c-b469-99d70c3ee845 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:53.446974 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4621bce3-fa65-457c-b469-99d70c3ee845 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:53.447619 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4621bce3-fa65-457c-b469-99d70c3ee845 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:53.668052 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-4621bce3-fa65-457c-b469-99d70c3ee845 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:53.677564 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-4621bce3-fa65-457c-b469-99d70c3ee845 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.245373 Nov 23 07:45:53.686830 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 224/473] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:53 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:54.085215 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-65dcb594-60ab-4ad3-b3c4-4851ece8dc8d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:54.085989 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-65dcb594-60ab-4ad3-b3c4-4851ece8dc8d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:54.096991 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-65dcb594-60ab-4ad3-b3c4-4851ece8dc8d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:54.097728 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-65dcb594-60ab-4ad3-b3c4-4851ece8dc8d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:54.098774 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-65dcb594-60ab-4ad3-b3c4-4851ece8dc8d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:54.099283 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-65dcb594-60ab-4ad3-b3c4-4851ece8dc8d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:54.267179 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-65dcb594-60ab-4ad3-b3c4-4851ece8dc8d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:54.277820 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-65dcb594-60ab-4ad3-b3c4-4851ece8dc8d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:54.279397 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-65dcb594-60ab-4ad3-b3c4-4851ece8dc8d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:54.280569 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-65dcb594-60ab-4ad3-b3c4-4851ece8dc8d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1737 microversion: 2.20 time: 0.200239 Nov 23 07:45:54.281532 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 250/474] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:54 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1737 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:54.695190 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c8d1f2f0-a75a-48ce-bf86-029455108c3c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:54.695795 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c8d1f2f0-a75a-48ce-bf86-029455108c3c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:54.702446 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c8d1f2f0-a75a-48ce-bf86-029455108c3c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:54.702878 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c8d1f2f0-a75a-48ce-bf86-029455108c3c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:54.703886 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c8d1f2f0-a75a-48ce-bf86-029455108c3c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:54.704478 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c8d1f2f0-a75a-48ce-bf86-029455108c3c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:54.863243 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c8d1f2f0-a75a-48ce-bf86-029455108c3c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:54.872302 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c8d1f2f0-a75a-48ce-bf86-029455108c3c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.180791 Nov 23 07:45:54.873593 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 225/475] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:54 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:55.298582 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-05d85d66-0abd-4ab9-bda0-52bddace7c1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:55.299300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-05d85d66-0abd-4ab9-bda0-52bddace7c1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:55.306627 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-05d85d66-0abd-4ab9-bda0-52bddace7c1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:55.307398 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-05d85d66-0abd-4ab9-bda0-52bddace7c1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:55.308400 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-05d85d66-0abd-4ab9-bda0-52bddace7c1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:55.309048 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-05d85d66-0abd-4ab9-bda0-52bddace7c1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:55.478259 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-05d85d66-0abd-4ab9-bda0-52bddace7c1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:55.486888 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-05d85d66-0abd-4ab9-bda0-52bddace7c1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:55.488400 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-05d85d66-0abd-4ab9-bda0-52bddace7c1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:55.489741 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-05d85d66-0abd-4ab9-bda0-52bddace7c1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1737 microversion: 2.20 time: 0.194822 Nov 23 07:45:55.503358 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 251/476] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:55 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:55.891176 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-a3c6db3e-eb5f-4bc5-a2c1-14840cc04615 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:55.892422 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-a3c6db3e-eb5f-4bc5-a2c1-14840cc04615 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:55.901075 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a3c6db3e-eb5f-4bc5-a2c1-14840cc04615 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:55.901775 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a3c6db3e-eb5f-4bc5-a2c1-14840cc04615 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:55.902893 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a3c6db3e-eb5f-4bc5-a2c1-14840cc04615 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:55.903659 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a3c6db3e-eb5f-4bc5-a2c1-14840cc04615 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:56.090291 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a3c6db3e-eb5f-4bc5-a2c1-14840cc04615 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:56.098463 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-a3c6db3e-eb5f-4bc5-a2c1-14840cc04615 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.211466 Nov 23 07:45:56.099434 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 226/477] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:55 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:56.521745 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-61438fc2-ee04-4a8a-b2f1-f4e45c18c467 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:56.522696 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-61438fc2-ee04-4a8a-b2f1-f4e45c18c467 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:56.548822 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-61438fc2-ee04-4a8a-b2f1-f4e45c18c467 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:56.549901 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-61438fc2-ee04-4a8a-b2f1-f4e45c18c467 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:56.551325 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-61438fc2-ee04-4a8a-b2f1-f4e45c18c467 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:56.552002 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-61438fc2-ee04-4a8a-b2f1-f4e45c18c467 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:56.815572 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-61438fc2-ee04-4a8a-b2f1-f4e45c18c467 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:56.830551 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-61438fc2-ee04-4a8a-b2f1-f4e45c18c467 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:56.836283 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-61438fc2-ee04-4a8a-b2f1-f4e45c18c467 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:56.838281 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-61438fc2-ee04-4a8a-b2f1-f4e45c18c467 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1719 microversion: 2.20 time: 0.320229 Nov 23 07:45:56.848412 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 252/478] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:56 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1719 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:57.116994 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-27beefe9-778d-48f3-a1cd-fcae9b974d24 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:57.118821 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-27beefe9-778d-48f3-a1cd-fcae9b974d24 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:57.125804 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-27beefe9-778d-48f3-a1cd-fcae9b974d24 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:57.126512 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-27beefe9-778d-48f3-a1cd-fcae9b974d24 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:57.127515 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-27beefe9-778d-48f3-a1cd-fcae9b974d24 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:57.128165 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-27beefe9-778d-48f3-a1cd-fcae9b974d24 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:57.274954 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-27beefe9-778d-48f3-a1cd-fcae9b974d24 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:57.285088 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-27beefe9-778d-48f3-a1cd-fcae9b974d24 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.171585 Nov 23 07:45:57.286449 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 227/479] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:57 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:45:57.863277 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-9128a6f5-7344-4cd9-971e-9590f3e38d4f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:57.864618 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-9128a6f5-7344-4cd9-971e-9590f3e38d4f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:57.871296 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9128a6f5-7344-4cd9-971e-9590f3e38d4f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:57.871873 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9128a6f5-7344-4cd9-971e-9590f3e38d4f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:57.872784 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9128a6f5-7344-4cd9-971e-9590f3e38d4f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:57.873218 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9128a6f5-7344-4cd9-971e-9590f3e38d4f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:58.048986 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-9128a6f5-7344-4cd9-971e-9590f3e38d4f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:58.069357 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-9128a6f5-7344-4cd9-971e-9590f3e38d4f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:58.071402 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-9128a6f5-7344-4cd9-971e-9590f3e38d4f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:58.072932 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-9128a6f5-7344-4cd9-971e-9590f3e38d4f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1719 microversion: 2.20 time: 0.214092 Nov 23 07:45:58.084665 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 253/480] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:57 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1719 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:58.304632 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5ff498be-b20f-4dda-8150-c3865848d30e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:58.307714 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5ff498be-b20f-4dda-8150-c3865848d30e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:58.315427 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5ff498be-b20f-4dda-8150-c3865848d30e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:58.316640 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5ff498be-b20f-4dda-8150-c3865848d30e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:58.317964 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5ff498be-b20f-4dda-8150-c3865848d30e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:58.318677 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5ff498be-b20f-4dda-8150-c3865848d30e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:58.506202 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5ff498be-b20f-4dda-8150-c3865848d30e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:58.516799 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5ff498be-b20f-4dda-8150-c3865848d30e tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.216823 Nov 23 07:45:58.517739 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 228/481] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:58 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:45:59.090849 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-629755e9-d457-4bca-9667-c8ad9ad2a136 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:59.091617 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-629755e9-d457-4bca-9667-c8ad9ad2a136 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:59.098220 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-629755e9-d457-4bca-9667-c8ad9ad2a136 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:59.098686 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-629755e9-d457-4bca-9667-c8ad9ad2a136 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:59.099486 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-629755e9-d457-4bca-9667-c8ad9ad2a136 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:59.100076 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-629755e9-d457-4bca-9667-c8ad9ad2a136 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:59.253202 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-629755e9-d457-4bca-9667-c8ad9ad2a136 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:59.262442 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-629755e9-d457-4bca-9667-c8ad9ad2a136 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:59.264464 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-629755e9-d457-4bca-9667-c8ad9ad2a136 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:59.269380 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-629755e9-d457-4bca-9667-c8ad9ad2a136 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1719 microversion: 2.20 time: 0.182397 Nov 23 07:45:59.270362 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 254/482] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:45:59 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:45:59.536087 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5cfe5809-b760-448d-b2ca-61adf90e9404 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:45:59.536657 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5cfe5809-b760-448d-b2ca-61adf90e9404 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:45:59.545464 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5cfe5809-b760-448d-b2ca-61adf90e9404 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:59.546424 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5cfe5809-b760-448d-b2ca-61adf90e9404 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:59.547766 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5cfe5809-b760-448d-b2ca-61adf90e9404 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:45:59.548494 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5cfe5809-b760-448d-b2ca-61adf90e9404 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:45:59.721241 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5cfe5809-b760-448d-b2ca-61adf90e9404 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:45:59.731225 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5cfe5809-b760-448d-b2ca-61adf90e9404 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.199159 Nov 23 07:45:59.732187 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 229/483] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:45:59 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:00.289045 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-59450ff0-3a10-4426-8e78-c79850b9a514 req-80399d9a-b52b-4b6b-8b18-72bdf0e26100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb841a35-6344-43a0-85d2-6de8116759b1", "name": "network-vif-unplugged", "status": "completed", "tag": "8b4fce4b-5f2b-4eea-8335-5d57ac70511e"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:46:00.294380 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-7b783041-398b-45f3-8635-f211c49ddbe1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:00.295165 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-7b783041-398b-45f3-8635-f211c49ddbe1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:00.299462 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:46:00.299462 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:46:00.306061 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7b783041-398b-45f3-8635-f211c49ddbe1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:00.308038 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7b783041-398b-45f3-8635-f211c49ddbe1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:00.309502 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7b783041-398b-45f3-8635-f211c49ddbe1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:00.311462 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7b783041-398b-45f3-8635-f211c49ddbe1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:00.321910 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-59450ff0-3a10-4426-8e78-c79850b9a514 req-80399d9a-b52b-4b6b-8b18-72bdf0e26100 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:00.322368 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-59450ff0-3a10-4426-8e78-c79850b9a514 req-80399d9a-b52b-4b6b-8b18-72bdf0e26100 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:00.358401 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-59450ff0-3a10-4426-8e78-c79850b9a514 req-80399d9a-b52b-4b6b-8b18-72bdf0e26100 service nova] Creating event network-vif-unplugged:8b4fce4b-5f2b-4eea-8335-5d57ac70511e for instance bb841a35-6344-43a0-85d2-6de8116759b1 on hv-cinder-80403 Nov 23 07:46:00.368649 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-59450ff0-3a10-4426-8e78-c79850b9a514 req-80399d9a-b52b-4b6b-8b18-72bdf0e26100 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091201 Nov 23 07:46:00.369971 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 255/484] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:46:00 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:46:00.569306 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-7b783041-398b-45f3-8635-f211c49ddbe1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:00.582358 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-7b783041-398b-45f3-8635-f211c49ddbe1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:00.584057 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-7b783041-398b-45f3-8635-f211c49ddbe1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:00.585354 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-7b783041-398b-45f3-8635-f211c49ddbe1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1719 microversion: 2.20 time: 0.296375 Nov 23 07:46:00.599196 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 230/485] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:00 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1719 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:46:00.751955 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-5f1c62ea-e8b2-49c8-be9b-7d528ead2a4f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:00.752756 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-5f1c62ea-e8b2-49c8-be9b-7d528ead2a4f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:00.759866 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5f1c62ea-e8b2-49c8-be9b-7d528ead2a4f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:00.760359 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5f1c62ea-e8b2-49c8-be9b-7d528ead2a4f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:00.762842 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5f1c62ea-e8b2-49c8-be9b-7d528ead2a4f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:00.763287 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5f1c62ea-e8b2-49c8-be9b-7d528ead2a4f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:00.958675 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5f1c62ea-e8b2-49c8-be9b-7d528ead2a4f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:00.969551 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-5f1c62ea-e8b2-49c8-be9b-7d528ead2a4f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.222302 Nov 23 07:46:00.988161 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 256/486] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:00 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:01.606489 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ccb7c0e1-e95c-48ba-9541-6f8616e0c6a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:01.607108 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ccb7c0e1-e95c-48ba-9541-6f8616e0c6a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:01.613561 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ccb7c0e1-e95c-48ba-9541-6f8616e0c6a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:01.614039 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ccb7c0e1-e95c-48ba-9541-6f8616e0c6a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:01.614833 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ccb7c0e1-e95c-48ba-9541-6f8616e0c6a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:01.615259 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ccb7c0e1-e95c-48ba-9541-6f8616e0c6a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:01.772742 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ccb7c0e1-e95c-48ba-9541-6f8616e0c6a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:01.782125 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ccb7c0e1-e95c-48ba-9541-6f8616e0c6a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:01.783859 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ccb7c0e1-e95c-48ba-9541-6f8616e0c6a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:01.785130 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ccb7c0e1-e95c-48ba-9541-6f8616e0c6a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1719 microversion: 2.20 time: 0.182477 Nov 23 07:46:01.785791 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 231/487] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:01 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:01.996172 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d9e03c0d-96cd-4e35-818e-4f5f933d9bc4 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:01.997030 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d9e03c0d-96cd-4e35-818e-4f5f933d9bc4 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:02.004029 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d9e03c0d-96cd-4e35-818e-4f5f933d9bc4 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:02.004819 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d9e03c0d-96cd-4e35-818e-4f5f933d9bc4 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:02.005751 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d9e03c0d-96cd-4e35-818e-4f5f933d9bc4 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:02.006429 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d9e03c0d-96cd-4e35-818e-4f5f933d9bc4 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:02.162589 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d9e03c0d-96cd-4e35-818e-4f5f933d9bc4 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:02.174348 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d9e03c0d-96cd-4e35-818e-4f5f933d9bc4 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.182334 Nov 23 07:46:02.175040 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 257/488] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:01 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:02.804430 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-749cc0af-f2d6-43bf-8344-634d4219bf6d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:02.805870 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-749cc0af-f2d6-43bf-8344-634d4219bf6d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:02.816490 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-749cc0af-f2d6-43bf-8344-634d4219bf6d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:02.817250 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-749cc0af-f2d6-43bf-8344-634d4219bf6d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:02.818344 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-749cc0af-f2d6-43bf-8344-634d4219bf6d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:02.818792 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-749cc0af-f2d6-43bf-8344-634d4219bf6d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:02.970015 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-749cc0af-f2d6-43bf-8344-634d4219bf6d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:02.983479 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-749cc0af-f2d6-43bf-8344-634d4219bf6d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:02.985287 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-749cc0af-f2d6-43bf-8344-634d4219bf6d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:02.986564 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-749cc0af-f2d6-43bf-8344-634d4219bf6d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1719 microversion: 2.20 time: 0.186551 Nov 23 07:46:02.987335 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 232/489] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:02 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1719 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:03.192650 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-23c828a5-fdd4-4159-8325-b5d38b4b2a9a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:03.194355 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-23c828a5-fdd4-4159-8325-b5d38b4b2a9a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:03.204451 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-23c828a5-fdd4-4159-8325-b5d38b4b2a9a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:03.205530 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-23c828a5-fdd4-4159-8325-b5d38b4b2a9a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:03.206902 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-23c828a5-fdd4-4159-8325-b5d38b4b2a9a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:03.207757 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-23c828a5-fdd4-4159-8325-b5d38b4b2a9a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:03.370212 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-23c828a5-fdd4-4159-8325-b5d38b4b2a9a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:03.379071 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-23c828a5-fdd4-4159-8325-b5d38b4b2a9a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.190257 Nov 23 07:46:03.379653 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 258/490] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:03 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:04.007358 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-553ff01d-0cd3-4999-8581-0fa5ab8c2c70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:04.008368 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-553ff01d-0cd3-4999-8581-0fa5ab8c2c70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:04.016648 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-553ff01d-0cd3-4999-8581-0fa5ab8c2c70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:04.017254 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-553ff01d-0cd3-4999-8581-0fa5ab8c2c70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:04.018368 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-553ff01d-0cd3-4999-8581-0fa5ab8c2c70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:04.019103 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-553ff01d-0cd3-4999-8581-0fa5ab8c2c70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:04.182793 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-553ff01d-0cd3-4999-8581-0fa5ab8c2c70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:04.189200 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-553ff01d-0cd3-4999-8581-0fa5ab8c2c70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:04.192120 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-553ff01d-0cd3-4999-8581-0fa5ab8c2c70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:04.194476 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-553ff01d-0cd3-4999-8581-0fa5ab8c2c70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1719 microversion: 2.20 time: 0.190701 Nov 23 07:46:04.206021 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 233/491] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:04 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1719 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:04.396450 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-875d011b-33b9-47db-a69f-3b52b41d62d8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:04.397061 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-875d011b-33b9-47db-a69f-3b52b41d62d8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:04.407153 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-875d011b-33b9-47db-a69f-3b52b41d62d8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:04.407962 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-875d011b-33b9-47db-a69f-3b52b41d62d8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:04.409132 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-875d011b-33b9-47db-a69f-3b52b41d62d8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:04.409818 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-875d011b-33b9-47db-a69f-3b52b41d62d8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:04.575459 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-875d011b-33b9-47db-a69f-3b52b41d62d8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:04.592773 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-875d011b-33b9-47db-a69f-3b52b41d62d8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.200086 Nov 23 07:46:04.594066 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 259/492] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:04 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:05.216079 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f7eb50cd-5a9d-42ac-94f8-c9a5a08faa6c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:05.217328 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f7eb50cd-5a9d-42ac-94f8-c9a5a08faa6c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:05.229461 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f7eb50cd-5a9d-42ac-94f8-c9a5a08faa6c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:05.229930 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f7eb50cd-5a9d-42ac-94f8-c9a5a08faa6c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:05.230736 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f7eb50cd-5a9d-42ac-94f8-c9a5a08faa6c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:05.231184 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f7eb50cd-5a9d-42ac-94f8-c9a5a08faa6c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:05.403406 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f7eb50cd-5a9d-42ac-94f8-c9a5a08faa6c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:05.412220 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f7eb50cd-5a9d-42ac-94f8-c9a5a08faa6c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:05.414213 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f7eb50cd-5a9d-42ac-94f8-c9a5a08faa6c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:05.415650 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f7eb50cd-5a9d-42ac-94f8-c9a5a08faa6c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1719 microversion: 2.20 time: 0.203660 Nov 23 07:46:05.416375 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 234/493] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:05 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1719 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:05.610843 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-5f7146dc-065a-4124-ac2a-7df8b1fa5d6a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:05.611477 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-5f7146dc-065a-4124-ac2a-7df8b1fa5d6a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:05.618885 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5f7146dc-065a-4124-ac2a-7df8b1fa5d6a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:05.621400 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5f7146dc-065a-4124-ac2a-7df8b1fa5d6a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:05.623646 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5f7146dc-065a-4124-ac2a-7df8b1fa5d6a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:05.624431 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5f7146dc-065a-4124-ac2a-7df8b1fa5d6a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:05.879854 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5f7146dc-065a-4124-ac2a-7df8b1fa5d6a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:05.893534 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-5f7146dc-065a-4124-ac2a-7df8b1fa5d6a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.286614 Nov 23 07:46:05.896433 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 260/494] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:05 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:05.925177 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-1efe01d3-e632-45cb-9feb-fff7c122cfcd tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:05.925905 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-1efe01d3-e632-45cb-9feb-fff7c122cfcd tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:05.932207 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1efe01d3-e632-45cb-9feb-fff7c122cfcd tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:05.932643 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1efe01d3-e632-45cb-9feb-fff7c122cfcd tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:05.933539 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1efe01d3-e632-45cb-9feb-fff7c122cfcd tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:05.934077 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1efe01d3-e632-45cb-9feb-fff7c122cfcd tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:06.123489 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-1efe01d3-e632-45cb-9feb-fff7c122cfcd tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:06.145671 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-1efe01d3-e632-45cb-9feb-fff7c122cfcd tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1593 microversion: 2.1 time: 0.222852 Nov 23 07:46:06.148078 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 235/495] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:05 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1593 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:06.436993 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-7e4d7493-f4a7-4578-ac3d-35aae1118689 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:06.437610 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-7e4d7493-f4a7-4578-ac3d-35aae1118689 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:06.443656 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7e4d7493-f4a7-4578-ac3d-35aae1118689 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:06.444452 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7e4d7493-f4a7-4578-ac3d-35aae1118689 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:06.445272 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7e4d7493-f4a7-4578-ac3d-35aae1118689 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:06.445724 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7e4d7493-f4a7-4578-ac3d-35aae1118689 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:06.640817 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-7e4d7493-f4a7-4578-ac3d-35aae1118689 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:06.651224 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-7e4d7493-f4a7-4578-ac3d-35aae1118689 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:06.653100 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-7e4d7493-f4a7-4578-ac3d-35aae1118689 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:06.655860 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-7e4d7493-f4a7-4578-ac3d-35aae1118689 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1722 microversion: 2.20 time: 0.224802 Nov 23 07:46:06.657046 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 261/496] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:06 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:06.679833 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-42c32b44-ee5a-492c-a729-862c7de03aad tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "429d8e19-c9dc-4e98-abaf-e393fa581c28"}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:46:06.682512 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-42c32b44-ee5a-492c-a729-862c7de03aad tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:06.692138 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-42c32b44-ee5a-492c-a729-862c7de03aad tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:06.693040 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-42c32b44-ee5a-492c-a729-862c7de03aad tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:06.694186 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-42c32b44-ee5a-492c-a729-862c7de03aad tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:06.695561 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-42c32b44-ee5a-492c-a729-862c7de03aad tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:06.917092 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e430850a-2e1c-4653-8820-68111942b50a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:06.918733 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e430850a-2e1c-4653-8820-68111942b50a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:06.929298 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e430850a-2e1c-4653-8820-68111942b50a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:06.930270 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e430850a-2e1c-4653-8820-68111942b50a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:06.931830 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e430850a-2e1c-4653-8820-68111942b50a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:06.933461 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e430850a-2e1c-4653-8820-68111942b50a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:07.133269 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-e430850a-2e1c-4653-8820-68111942b50a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:07.142346 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e430850a-2e1c-4653-8820-68111942b50a tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.233253 Nov 23 07:46:07.143695 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 262/497] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:06 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:07.195476 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-42c32b44-ee5a-492c-a729-862c7de03aad tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.519711 Nov 23 07:46:07.196156 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 236/498] 10.222.0.48 () {62 vars in 1363 bytes} [Tue Nov 23 07:46:06 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/os-volume_attachments => generated 188 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:46:07.375795 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-da856de9-622e-4f66-a25e-bbcce54b7d8a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:46:07.377072 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-da856de9-622e-4f66-a25e-bbcce54b7d8a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:07.384290 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-da856de9-622e-4f66-a25e-bbcce54b7d8a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:07.384866 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-da856de9-622e-4f66-a25e-bbcce54b7d8a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:07.387149 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-da856de9-622e-4f66-a25e-bbcce54b7d8a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:07.387867 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-da856de9-622e-4f66-a25e-bbcce54b7d8a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:07.520588 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-da856de9-622e-4f66-a25e-bbcce54b7d8a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action" status: 202 len: 0 microversion: 2.20 time: 0.151140 Nov 23 07:46:07.523997 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 263/499] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:46:07 2021] POST /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 07:46:07.531739 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-497c494c-bee4-4d45-8327-938948e19a7d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:07.532357 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-497c494c-bee4-4d45-8327-938948e19a7d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:07.541434 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-497c494c-bee4-4d45-8327-938948e19a7d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:07.541918 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-497c494c-bee4-4d45-8327-938948e19a7d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:07.542732 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-497c494c-bee4-4d45-8327-938948e19a7d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:07.543173 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-497c494c-bee4-4d45-8327-938948e19a7d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:07.973633 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-497c494c-bee4-4d45-8327-938948e19a7d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:07.984433 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-497c494c-bee4-4d45-8327-938948e19a7d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:07.992384 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-497c494c-bee4-4d45-8327-938948e19a7d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:07.998817 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-497c494c-bee4-4d45-8327-938948e19a7d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1748 microversion: 2.20 time: 0.470670 Nov 23 07:46:08.020615 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 237/500] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:07 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1748 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:08.160333 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6d070559-039c-4494-9d96-d88a9a485eb5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:08.160908 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6d070559-039c-4494-9d96-d88a9a485eb5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:08.172459 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6d070559-039c-4494-9d96-d88a9a485eb5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:08.173196 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6d070559-039c-4494-9d96-d88a9a485eb5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:08.175312 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6d070559-039c-4494-9d96-d88a9a485eb5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:08.176094 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6d070559-039c-4494-9d96-d88a9a485eb5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:08.378453 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6d070559-039c-4494-9d96-d88a9a485eb5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:08.393108 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6d070559-039c-4494-9d96-d88a9a485eb5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.236570 Nov 23 07:46:08.394960 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 264/501] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:08 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:08.747880 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-74d4fee0-2964-4063-8cc5-f00d3d5b09c9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:08.748743 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-74d4fee0-2964-4063-8cc5-f00d3d5b09c9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:08.765680 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-74d4fee0-2964-4063-8cc5-f00d3d5b09c9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:08.767501 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-74d4fee0-2964-4063-8cc5-f00d3d5b09c9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:08.769404 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-74d4fee0-2964-4063-8cc5-f00d3d5b09c9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:08.771150 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-74d4fee0-2964-4063-8cc5-f00d3d5b09c9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:08.961085 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.objects.instance [None req-74d4fee0-2964-4063-8cc5-f00d3d5b09c9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lazy-loading 'services' on Instance uuid 732e1298-1293-4cb3-833a-264392fb9ddf {{(pid=122785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:46:09.040191 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-aec4e869-0176-4aca-9f69-22c7d1318177 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:09.041543 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-aec4e869-0176-4aca-9f69-22c7d1318177 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:09.104428 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aec4e869-0176-4aca-9f69-22c7d1318177 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:09.109221 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aec4e869-0176-4aca-9f69-22c7d1318177 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:09.111806 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aec4e869-0176-4aca-9f69-22c7d1318177 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:09.113808 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aec4e869-0176-4aca-9f69-22c7d1318177 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:09.124291 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-74d4fee0-2964-4063-8cc5-f00d3d5b09c9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "DELETE /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf/os-volume_attachments/c2cd0bb1-42f8-4255-aefd-c05b9367ae70" status: 202 len: 0 microversion: 2.1 time: 0.385231 Nov 23 07:46:09.130975 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 238/502] 10.222.0.48 () {58 vars in 1415 bytes} [Tue Nov 23 07:46:08 2021] DELETE /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf/os-volume_attachments/c2cd0bb1-42f8-4255-aefd-c05b9367ae70 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:46:09.168530 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-96e07a7e-0f4f-4d60-b773-5300f1ee9d85 req-d7f6fee3-b84d-48be-aec9-bcc296f34011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "842f1da9-1085-4946-b62b-9ae2c5ad009b", "tag": "46440f82-0a6b-4d97-82a5-b146d1263ea9"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:46:09.186990 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:46:09.186990 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:46:09.230709 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-96e07a7e-0f4f-4d60-b773-5300f1ee9d85 req-d7f6fee3-b84d-48be-aec9-bcc296f34011 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:09.232413 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-96e07a7e-0f4f-4d60-b773-5300f1ee9d85 req-d7f6fee3-b84d-48be-aec9-bcc296f34011 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:09.290228 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-96e07a7e-0f4f-4d60-b773-5300f1ee9d85 req-d7f6fee3-b84d-48be-aec9-bcc296f34011 service nova] Creating event network-changed:46440f82-0a6b-4d97-82a5-b146d1263ea9 for instance 842f1da9-1085-4946-b62b-9ae2c5ad009b on hv-cinder-80403 Nov 23 07:46:09.303487 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-96e07a7e-0f4f-4d60-b773-5300f1ee9d85 req-d7f6fee3-b84d-48be-aec9-bcc296f34011 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155415 Nov 23 07:46:09.311995 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 239/503] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:46:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:46:09.412822 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-bfa031c9-848b-4b1b-a4e0-8bd8c87a0318 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:09.414739 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-bfa031c9-848b-4b1b-a4e0-8bd8c87a0318 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:09.426850 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bfa031c9-848b-4b1b-a4e0-8bd8c87a0318 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:09.430865 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bfa031c9-848b-4b1b-a4e0-8bd8c87a0318 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:09.433619 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bfa031c9-848b-4b1b-a4e0-8bd8c87a0318 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:09.439358 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bfa031c9-848b-4b1b-a4e0-8bd8c87a0318 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:09.659950 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-aec4e869-0176-4aca-9f69-22c7d1318177 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:09.678335 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-aec4e869-0176-4aca-9f69-22c7d1318177 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:09.681091 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-aec4e869-0176-4aca-9f69-22c7d1318177 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:09.684187 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-aec4e869-0176-4aca-9f69-22c7d1318177 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1750 microversion: 2.20 time: 0.654199 Nov 23 07:46:09.698812 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 265/504] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:09 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1750 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:10.031551 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-bfa031c9-848b-4b1b-a4e0-8bd8c87a0318 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:10.041866 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-bfa031c9-848b-4b1b-a4e0-8bd8c87a0318 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1568 microversion: 2.1 time: 0.632970 Nov 23 07:46:10.042462 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 240/505] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:09 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1568 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:10.714130 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d7cf720f-df10-4fde-bda3-619d924b8397 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:10.715596 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d7cf720f-df10-4fde-bda3-619d924b8397 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:10.729543 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d7cf720f-df10-4fde-bda3-619d924b8397 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:10.730060 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d7cf720f-df10-4fde-bda3-619d924b8397 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:10.730987 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d7cf720f-df10-4fde-bda3-619d924b8397 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:10.731462 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d7cf720f-df10-4fde-bda3-619d924b8397 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:10.994997 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d7cf720f-df10-4fde-bda3-619d924b8397 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:11.005565 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d7cf720f-df10-4fde-bda3-619d924b8397 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:11.008142 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d7cf720f-df10-4fde-bda3-619d924b8397 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:11.011037 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d7cf720f-df10-4fde-bda3-619d924b8397 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1750 microversion: 2.20 time: 0.302392 Nov 23 07:46:11.011621 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 266/506] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:10 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1750 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:11.064744 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-a50d08fb-07af-4442-bcb0-66e9cc5c5a2c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:11.068702 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-a50d08fb-07af-4442-bcb0-66e9cc5c5a2c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:11.082073 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a50d08fb-07af-4442-bcb0-66e9cc5c5a2c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:11.082523 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a50d08fb-07af-4442-bcb0-66e9cc5c5a2c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:11.083319 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a50d08fb-07af-4442-bcb0-66e9cc5c5a2c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:11.083752 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a50d08fb-07af-4442-bcb0-66e9cc5c5a2c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:11.269682 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a50d08fb-07af-4442-bcb0-66e9cc5c5a2c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:11.277799 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-a50d08fb-07af-4442-bcb0-66e9cc5c5a2c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1548 microversion: 2.1 time: 0.216544 Nov 23 07:46:11.278673 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 241/507] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:11 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1548 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:11.295536 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-48ff25fd-2906-4518-993b-e56b88e20666 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:11.296035 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-48ff25fd-2906-4518-993b-e56b88e20666 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:11.301824 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-48ff25fd-2906-4518-993b-e56b88e20666 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:11.302275 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-48ff25fd-2906-4518-993b-e56b88e20666 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:11.303140 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-48ff25fd-2906-4518-993b-e56b88e20666 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:11.303578 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-48ff25fd-2906-4518-993b-e56b88e20666 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:11.362680 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-9078cccc-d087-4f40-858f-5164533ed049 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1154738481"}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:46:11.363063 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-9078cccc-d087-4f40-858f-5164533ed049 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:11.371004 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9078cccc-d087-4f40-858f-5164533ed049 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:11.371689 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9078cccc-d087-4f40-858f-5164533ed049 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:11.372614 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9078cccc-d087-4f40-858f-5164533ed049 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:11.373168 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9078cccc-d087-4f40-858f-5164533ed049 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:11.430437 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-48ff25fd-2906-4518-993b-e56b88e20666 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] HTTP exception thrown: Cannot 'detach_volume' instance c5cba5f7-c9fd-4708-923c-deec6ab27cdd while it is in vm_state rescued Nov 23 07:46:11.431303 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-48ff25fd-2906-4518-993b-e56b88e20666 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Returning 409 to user: Cannot 'detach_volume' instance c5cba5f7-c9fd-4708-923c-deec6ab27cdd while it is in vm_state rescued {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:46:11.432144 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-48ff25fd-2906-4518-993b-e56b88e20666 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/os-volume_attachments/d3e0bbd4-ce1e-4b68-b50e-bc909648fd36" status: 409 len: 152 microversion: 2.1 time: 0.140495 Nov 23 07:46:11.432713 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 267/508] 10.222.0.48 () {58 vars in 1415 bytes} [Tue Nov 23 07:46:11 2021] DELETE /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/os-volume_attachments/d3e0bbd4-ce1e-4b68-b50e-bc909648fd36 => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 23 07:46:11.440818 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-aec089a9-a7f4-4bc3-a7b7-cf35117eacb2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:46:11.441444 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-aec089a9-a7f4-4bc3-a7b7-cf35117eacb2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:11.450350 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aec089a9-a7f4-4bc3-a7b7-cf35117eacb2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:11.451093 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aec089a9-a7f4-4bc3-a7b7-cf35117eacb2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:11.452084 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aec089a9-a7f4-4bc3-a7b7-cf35117eacb2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:11.452688 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aec089a9-a7f4-4bc3-a7b7-cf35117eacb2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:11.530765 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-aec089a9-a7f4-4bc3-a7b7-cf35117eacb2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "POST /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/action" status: 202 len: 0 microversion: 2.1 time: 0.093269 Nov 23 07:46:11.531818 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 268/509] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:46:11 2021] POST /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:46:11.540937 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-26e015af-1e33-4723-90e9-478f8834e349 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:11.542264 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-26e015af-1e33-4723-90e9-478f8834e349 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:11.550119 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-26e015af-1e33-4723-90e9-478f8834e349 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:11.550777 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-26e015af-1e33-4723-90e9-478f8834e349 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:11.551579 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-26e015af-1e33-4723-90e9-478f8834e349 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:11.552090 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-26e015af-1e33-4723-90e9-478f8834e349 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:11.634988 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.network.security_group_api [None req-9078cccc-d087-4f40-858f-5164533ed049 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Adding security group ac4d94c8-741e-41a3-a6ad-e0e3518355fe to port 46440f82-0a6b-4d97-82a5-b146d1263ea9 Nov 23 07:46:11.719204 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-26e015af-1e33-4723-90e9-478f8834e349 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:11.727693 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-26e015af-1e33-4723-90e9-478f8834e349 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1556 microversion: 2.1 time: 0.191442 Nov 23 07:46:11.728293 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 269/510] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:11 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1556 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:46:12.030081 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1e277e82-1ee2-4f7e-b3e4-226f557dfad6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:12.030944 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1e277e82-1ee2-4f7e-b3e4-226f557dfad6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:12.036628 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e277e82-1ee2-4f7e-b3e4-226f557dfad6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:12.037073 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e277e82-1ee2-4f7e-b3e4-226f557dfad6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:12.037879 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e277e82-1ee2-4f7e-b3e4-226f557dfad6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:12.038586 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e277e82-1ee2-4f7e-b3e4-226f557dfad6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:12.174361 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1e277e82-1ee2-4f7e-b3e4-226f557dfad6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:12.182774 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1e277e82-1ee2-4f7e-b3e4-226f557dfad6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:12.184327 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1e277e82-1ee2-4f7e-b3e4-226f557dfad6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:12.185421 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1e277e82-1ee2-4f7e-b3e4-226f557dfad6 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.159056 Nov 23 07:46:12.186023 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 270/511] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:12 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:46:12.514159 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-9078cccc-d087-4f40-858f-5164533ed049 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "POST /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/action" status: 202 len: 0 microversion: 2.1 time: 1.155364 Nov 23 07:46:12.524349 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-48f3a59f-1a7b-4e6b-80b6-b52280a58682 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:12.525578 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 242/512] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:46:11 2021] POST /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/action => generated 0 bytes in 1167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:46:12.526781 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-48f3a59f-1a7b-4e6b-80b6-b52280a58682 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:12.531575 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-1287f165-c244-4b31-b6c9-bba483394d48 req-21e534ea-35f3-47ea-8306-7207d0bb51ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "842f1da9-1085-4946-b62b-9ae2c5ad009b", "tag": "46440f82-0a6b-4d97-82a5-b146d1263ea9"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:46:12.535854 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:46:12.535854 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:46:12.551062 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-48f3a59f-1a7b-4e6b-80b6-b52280a58682 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:12.553511 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-48f3a59f-1a7b-4e6b-80b6-b52280a58682 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:12.554535 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-48f3a59f-1a7b-4e6b-80b6-b52280a58682 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:12.555639 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-48f3a59f-1a7b-4e6b-80b6-b52280a58682 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:12.560578 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-1287f165-c244-4b31-b6c9-bba483394d48 req-21e534ea-35f3-47ea-8306-7207d0bb51ef service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:12.561373 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-1287f165-c244-4b31-b6c9-bba483394d48 req-21e534ea-35f3-47ea-8306-7207d0bb51ef service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:12.580894 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-1287f165-c244-4b31-b6c9-bba483394d48 req-21e534ea-35f3-47ea-8306-7207d0bb51ef service nova] Creating event network-changed:46440f82-0a6b-4d97-82a5-b146d1263ea9 for instance 842f1da9-1085-4946-b62b-9ae2c5ad009b on hv-cinder-80403 Nov 23 07:46:12.600752 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-1287f165-c244-4b31-b6c9-bba483394d48 req-21e534ea-35f3-47ea-8306-7207d0bb51ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072457 Nov 23 07:46:12.606625 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 243/513] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:46:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:46:12.611961 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-640d9543-9bfb-40ce-bfbe-8083dadbe3ed tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:12.616829 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-640d9543-9bfb-40ce-bfbe-8083dadbe3ed tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:12.629323 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-640d9543-9bfb-40ce-bfbe-8083dadbe3ed tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:12.629936 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-640d9543-9bfb-40ce-bfbe-8083dadbe3ed tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:12.630960 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-640d9543-9bfb-40ce-bfbe-8083dadbe3ed tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:12.631602 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-640d9543-9bfb-40ce-bfbe-8083dadbe3ed tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:12.676038 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-640d9543-9bfb-40ce-bfbe-8083dadbe3ed tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Going to try to terminate instance {{(pid=122785) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:46:12.775273 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-640d9543-9bfb-40ce-bfbe-8083dadbe3ed tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "DELETE /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 204 len: 0 microversion: 2.1 time: 0.166690 Nov 23 07:46:12.776844 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 244/514] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:46:12 2021] DELETE /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 07:46:12.784781 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-1125f8d2-7d80-434c-b4ea-13a1569a9920 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:12.786038 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-1125f8d2-7d80-434c-b4ea-13a1569a9920 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:12.796462 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1125f8d2-7d80-434c-b4ea-13a1569a9920 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:12.797585 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1125f8d2-7d80-434c-b4ea-13a1569a9920 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:12.798819 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1125f8d2-7d80-434c-b4ea-13a1569a9920 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:12.800005 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1125f8d2-7d80-434c-b4ea-13a1569a9920 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:13.058781 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-1125f8d2-7d80-434c-b4ea-13a1569a9920 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:13.067084 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-1125f8d2-7d80-434c-b4ea-13a1569a9920 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1556 microversion: 2.1 time: 0.288543 Nov 23 07:46:13.067865 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 245/515] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:12 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1556 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:13.074110 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-743636c9-1f46-44f4-93a1-82dfdffaa7f2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:13.076165 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-743636c9-1f46-44f4-93a1-82dfdffaa7f2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:13.083814 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-743636c9-1f46-44f4-93a1-82dfdffaa7f2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:13.084561 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-743636c9-1f46-44f4-93a1-82dfdffaa7f2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:13.086109 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-743636c9-1f46-44f4-93a1-82dfdffaa7f2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:13.086701 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-743636c9-1f46-44f4-93a1-82dfdffaa7f2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:13.111347 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-48f3a59f-1a7b-4e6b-80b6-b52280a58682 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:13.128132 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-48f3a59f-1a7b-4e6b-80b6-b52280a58682 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1758 microversion: 2.1 time: 0.608062 Nov 23 07:46:13.158357 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 271/516] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:12 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1758 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:13.205918 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-301ca79a-2aed-4d51-9956-ebb6e617a146 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:13.206605 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-301ca79a-2aed-4d51-9956-ebb6e617a146 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:13.229163 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-301ca79a-2aed-4d51-9956-ebb6e617a146 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:13.230601 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-301ca79a-2aed-4d51-9956-ebb6e617a146 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:13.233764 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-301ca79a-2aed-4d51-9956-ebb6e617a146 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:13.234894 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-301ca79a-2aed-4d51-9956-ebb6e617a146 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:13.346456 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-743636c9-1f46-44f4-93a1-82dfdffaa7f2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:13.354209 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-743636c9-1f46-44f4-93a1-82dfdffaa7f2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1512 microversion: 2.1 time: 0.285121 Nov 23 07:46:13.354801 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 246/517] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:13 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1512 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:13.507944 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-301ca79a-2aed-4d51-9956-ebb6e617a146 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:13.519405 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-301ca79a-2aed-4d51-9956-ebb6e617a146 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:13.522013 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-301ca79a-2aed-4d51-9956-ebb6e617a146 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:13.523878 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-301ca79a-2aed-4d51-9956-ebb6e617a146 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.322497 Nov 23 07:46:13.535489 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 272/518] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:13 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:46:14.084185 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-6ffb9b0c-6b98-4d5b-b5a3-b75202e0c7d0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:14.084789 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-6ffb9b0c-6b98-4d5b-b5a3-b75202e0c7d0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:14.092644 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6ffb9b0c-6b98-4d5b-b5a3-b75202e0c7d0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:14.093095 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6ffb9b0c-6b98-4d5b-b5a3-b75202e0c7d0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:14.093924 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6ffb9b0c-6b98-4d5b-b5a3-b75202e0c7d0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:14.094363 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6ffb9b0c-6b98-4d5b-b5a3-b75202e0c7d0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:14.240613 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-6ffb9b0c-6b98-4d5b-b5a3-b75202e0c7d0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:14.252946 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-6ffb9b0c-6b98-4d5b-b5a3-b75202e0c7d0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1556 microversion: 2.1 time: 0.172324 Nov 23 07:46:14.253562 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 247/519] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:14 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:14.372251 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d1e67941-f3b0-45a5-9272-d14166292a17 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:14.372853 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d1e67941-f3b0-45a5-9272-d14166292a17 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:14.379185 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d1e67941-f3b0-45a5-9272-d14166292a17 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:14.379875 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d1e67941-f3b0-45a5-9272-d14166292a17 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:14.380832 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d1e67941-f3b0-45a5-9272-d14166292a17 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:14.381269 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d1e67941-f3b0-45a5-9272-d14166292a17 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:14.548571 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-8ae5c9a6-7cb3-46ea-b173-3e446389cb93 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:14.548883 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d1e67941-f3b0-45a5-9272-d14166292a17 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:14.549691 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-8ae5c9a6-7cb3-46ea-b173-3e446389cb93 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:14.558055 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d1e67941-f3b0-45a5-9272-d14166292a17 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1512 microversion: 2.1 time: 0.189812 Nov 23 07:46:14.559461 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 273/520] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:14 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1512 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:14.575583 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8ae5c9a6-7cb3-46ea-b173-3e446389cb93 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:14.577041 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8ae5c9a6-7cb3-46ea-b173-3e446389cb93 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:14.579881 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8ae5c9a6-7cb3-46ea-b173-3e446389cb93 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:14.581809 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8ae5c9a6-7cb3-46ea-b173-3e446389cb93 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:14.813088 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-8ae5c9a6-7cb3-46ea-b173-3e446389cb93 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:14.838466 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-8ae5c9a6-7cb3-46ea-b173-3e446389cb93 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:14.840611 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-8ae5c9a6-7cb3-46ea-b173-3e446389cb93 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:14.842277 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-8ae5c9a6-7cb3-46ea-b173-3e446389cb93 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.302713 Nov 23 07:46:14.843200 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 248/521] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:14 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:15.273216 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-81301494-f911-4634-9415-7756764803ff tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:15.274157 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-81301494-f911-4634-9415-7756764803ff tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:15.280676 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-81301494-f911-4634-9415-7756764803ff tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:15.281428 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-81301494-f911-4634-9415-7756764803ff tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:15.282561 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-81301494-f911-4634-9415-7756764803ff tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:15.283168 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-81301494-f911-4634-9415-7756764803ff tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:15.419938 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-81301494-f911-4634-9415-7756764803ff tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:15.428341 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-81301494-f911-4634-9415-7756764803ff tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1556 microversion: 2.1 time: 0.160456 Nov 23 07:46:15.428932 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 274/522] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:15 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:15.583721 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-2578830f-7ca3-4d66-838a-5c3be402dbb9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:15.584337 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-2578830f-7ca3-4d66-838a-5c3be402dbb9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:15.591484 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2578830f-7ca3-4d66-838a-5c3be402dbb9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:15.591935 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2578830f-7ca3-4d66-838a-5c3be402dbb9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:15.592728 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2578830f-7ca3-4d66-838a-5c3be402dbb9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:15.593160 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2578830f-7ca3-4d66-838a-5c3be402dbb9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:15.727359 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-2578830f-7ca3-4d66-838a-5c3be402dbb9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:15.734858 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-2578830f-7ca3-4d66-838a-5c3be402dbb9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1512 microversion: 2.1 time: 0.154848 Nov 23 07:46:15.735444 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 249/523] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:15 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:15.862396 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-2cb198be-dad6-40de-9eb2-846078b31277 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:15.863157 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-2cb198be-dad6-40de-9eb2-846078b31277 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:15.869316 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2cb198be-dad6-40de-9eb2-846078b31277 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:15.869872 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2cb198be-dad6-40de-9eb2-846078b31277 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:15.870662 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2cb198be-dad6-40de-9eb2-846078b31277 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:15.871097 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2cb198be-dad6-40de-9eb2-846078b31277 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:16.009568 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2cb198be-dad6-40de-9eb2-846078b31277 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:16.018754 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2cb198be-dad6-40de-9eb2-846078b31277 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:16.020375 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2cb198be-dad6-40de-9eb2-846078b31277 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:16.023852 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-2cb198be-dad6-40de-9eb2-846078b31277 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.163037 Nov 23 07:46:16.023852 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 275/524] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:15 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:16.445853 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-0ace0317-8df7-46c1-b991-33759e7330cc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:16.446688 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-0ace0317-8df7-46c1-b991-33759e7330cc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:16.452659 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0ace0317-8df7-46c1-b991-33759e7330cc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:16.453181 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0ace0317-8df7-46c1-b991-33759e7330cc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:16.454237 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0ace0317-8df7-46c1-b991-33759e7330cc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:16.454875 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0ace0317-8df7-46c1-b991-33759e7330cc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:16.658242 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0ace0317-8df7-46c1-b991-33759e7330cc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:16.667960 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-0ace0317-8df7-46c1-b991-33759e7330cc tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1556 microversion: 2.1 time: 0.226241 Nov 23 07:46:16.678391 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 250/525] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:16 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1556 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:16.751783 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d7a3e269-c977-4571-a326-5ce24a5db795 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:16.752437 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d7a3e269-c977-4571-a326-5ce24a5db795 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:16.759130 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d7a3e269-c977-4571-a326-5ce24a5db795 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:16.759584 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d7a3e269-c977-4571-a326-5ce24a5db795 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:16.760373 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d7a3e269-c977-4571-a326-5ce24a5db795 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:16.760811 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d7a3e269-c977-4571-a326-5ce24a5db795 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:16.902560 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d7a3e269-c977-4571-a326-5ce24a5db795 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:16.910048 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d7a3e269-c977-4571-a326-5ce24a5db795 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1512 microversion: 2.1 time: 0.161891 Nov 23 07:46:16.910617 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 276/526] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:16 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:17.041460 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-7cc8154a-39cf-424b-af8c-6efeac6f9fad tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:17.042491 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-7cc8154a-39cf-424b-af8c-6efeac6f9fad tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:17.049035 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7cc8154a-39cf-424b-af8c-6efeac6f9fad tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:17.049727 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7cc8154a-39cf-424b-af8c-6efeac6f9fad tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:17.050570 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7cc8154a-39cf-424b-af8c-6efeac6f9fad tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:17.051201 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7cc8154a-39cf-424b-af8c-6efeac6f9fad tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:17.195920 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-7cc8154a-39cf-424b-af8c-6efeac6f9fad tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:17.203975 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-7cc8154a-39cf-424b-af8c-6efeac6f9fad tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:17.205464 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-7cc8154a-39cf-424b-af8c-6efeac6f9fad tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:17.206644 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-7cc8154a-39cf-424b-af8c-6efeac6f9fad tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.170151 Nov 23 07:46:17.207209 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 251/527] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:17 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:17.695869 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-23ce7601-5159-457e-af6f-ff467ae6e3f9 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:17.696715 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-23ce7601-5159-457e-af6f-ff467ae6e3f9 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:17.703246 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-23ce7601-5159-457e-af6f-ff467ae6e3f9 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:17.703818 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-23ce7601-5159-457e-af6f-ff467ae6e3f9 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:17.704710 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-23ce7601-5159-457e-af6f-ff467ae6e3f9 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:17.705219 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-23ce7601-5159-457e-af6f-ff467ae6e3f9 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:17.845789 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-23ce7601-5159-457e-af6f-ff467ae6e3f9 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:17.854231 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-23ce7601-5159-457e-af6f-ff467ae6e3f9 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1556 microversion: 2.1 time: 0.162599 Nov 23 07:46:17.855069 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 277/528] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:17 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:17.928899 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-01aed864-3924-49c1-85f6-5db733060943 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:17.930966 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-01aed864-3924-49c1-85f6-5db733060943 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:17.938681 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-01aed864-3924-49c1-85f6-5db733060943 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:17.940354 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-01aed864-3924-49c1-85f6-5db733060943 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:17.941288 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-01aed864-3924-49c1-85f6-5db733060943 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:17.941803 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-01aed864-3924-49c1-85f6-5db733060943 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:18.092063 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-01aed864-3924-49c1-85f6-5db733060943 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:18.102119 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-01aed864-3924-49c1-85f6-5db733060943 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1512 microversion: 2.1 time: 0.176535 Nov 23 07:46:18.102925 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 252/529] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:17 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:18.226213 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-10162aa5-a07c-474c-ae41-ce39e116310f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:18.227002 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-10162aa5-a07c-474c-ae41-ce39e116310f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:18.233554 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-10162aa5-a07c-474c-ae41-ce39e116310f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:18.234217 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-10162aa5-a07c-474c-ae41-ce39e116310f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:18.235337 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-10162aa5-a07c-474c-ae41-ce39e116310f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:18.235785 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-10162aa5-a07c-474c-ae41-ce39e116310f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:18.385189 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-10162aa5-a07c-474c-ae41-ce39e116310f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:18.393993 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-10162aa5-a07c-474c-ae41-ce39e116310f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:18.395499 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-10162aa5-a07c-474c-ae41-ce39e116310f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:18.396671 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-10162aa5-a07c-474c-ae41-ce39e116310f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.174962 Nov 23 07:46:18.404370 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 278/530] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:18 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:46:18.872844 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3a2a8581-f509-435d-9580-e416364101f1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:18.873472 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3a2a8581-f509-435d-9580-e416364101f1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:18.879988 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3a2a8581-f509-435d-9580-e416364101f1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:18.880432 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3a2a8581-f509-435d-9580-e416364101f1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:18.881299 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3a2a8581-f509-435d-9580-e416364101f1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:18.881794 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3a2a8581-f509-435d-9580-e416364101f1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:19.026112 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-3a2a8581-f509-435d-9580-e416364101f1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:19.034419 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3a2a8581-f509-435d-9580-e416364101f1 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1556 microversion: 2.1 time: 0.165315 Nov 23 07:46:19.034999 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 253/531] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:18 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:19.119706 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-969fa848-9f21-48cc-9e5d-059817c495cd tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:19.120413 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-969fa848-9f21-48cc-9e5d-059817c495cd tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:19.127046 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-969fa848-9f21-48cc-9e5d-059817c495cd tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:19.127432 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-969fa848-9f21-48cc-9e5d-059817c495cd tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:19.128225 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-969fa848-9f21-48cc-9e5d-059817c495cd tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:19.128661 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-969fa848-9f21-48cc-9e5d-059817c495cd tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:19.267684 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-969fa848-9f21-48cc-9e5d-059817c495cd tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:19.276086 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-969fa848-9f21-48cc-9e5d-059817c495cd tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1512 microversion: 2.1 time: 0.160357 Nov 23 07:46:19.276628 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 279/532] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:19 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:19.415849 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-650bf4d5-6c44-4917-99ac-1bc91e515671 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:19.416611 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-650bf4d5-6c44-4917-99ac-1bc91e515671 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:19.423817 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-650bf4d5-6c44-4917-99ac-1bc91e515671 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:19.424628 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-650bf4d5-6c44-4917-99ac-1bc91e515671 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:19.425768 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-650bf4d5-6c44-4917-99ac-1bc91e515671 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:19.426509 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-650bf4d5-6c44-4917-99ac-1bc91e515671 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:19.577421 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-650bf4d5-6c44-4917-99ac-1bc91e515671 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:19.586311 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-650bf4d5-6c44-4917-99ac-1bc91e515671 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:19.587928 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-650bf4d5-6c44-4917-99ac-1bc91e515671 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:19.589147 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-650bf4d5-6c44-4917-99ac-1bc91e515671 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.177926 Nov 23 07:46:19.589744 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 254/533] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:19 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:20.052084 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-043f8ac0-fc1c-4736-ae3e-baaf8c63a600 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:20.052772 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-043f8ac0-fc1c-4736-ae3e-baaf8c63a600 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:20.059983 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-043f8ac0-fc1c-4736-ae3e-baaf8c63a600 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:20.060792 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-043f8ac0-fc1c-4736-ae3e-baaf8c63a600 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:20.062011 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-043f8ac0-fc1c-4736-ae3e-baaf8c63a600 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:20.062677 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-043f8ac0-fc1c-4736-ae3e-baaf8c63a600 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:20.211349 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-043f8ac0-fc1c-4736-ae3e-baaf8c63a600 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:20.219091 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-043f8ac0-fc1c-4736-ae3e-baaf8c63a600 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1556 microversion: 2.1 time: 0.170700 Nov 23 07:46:20.219649 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 280/534] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:20 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:20.293414 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-40c999d7-0f5f-45e3-abc3-b11f7ebac3e1 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:20.294139 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-40c999d7-0f5f-45e3-abc3-b11f7ebac3e1 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:20.307045 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40c999d7-0f5f-45e3-abc3-b11f7ebac3e1 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:20.307589 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40c999d7-0f5f-45e3-abc3-b11f7ebac3e1 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:20.308460 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40c999d7-0f5f-45e3-abc3-b11f7ebac3e1 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:20.311536 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40c999d7-0f5f-45e3-abc3-b11f7ebac3e1 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:20.461383 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-40c999d7-0f5f-45e3-abc3-b11f7ebac3e1 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:20.471723 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-40c999d7-0f5f-45e3-abc3-b11f7ebac3e1 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1512 microversion: 2.1 time: 0.182149 Nov 23 07:46:20.472518 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 255/535] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:20 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1512 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:20.610326 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b32ee04f-376a-45a2-be8f-5dfd3379cf70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:20.611079 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-b32ee04f-376a-45a2-be8f-5dfd3379cf70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:20.618571 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b32ee04f-376a-45a2-be8f-5dfd3379cf70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:20.619634 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b32ee04f-376a-45a2-be8f-5dfd3379cf70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:20.620760 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b32ee04f-376a-45a2-be8f-5dfd3379cf70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:20.621289 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b32ee04f-376a-45a2-be8f-5dfd3379cf70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:20.774218 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b32ee04f-376a-45a2-be8f-5dfd3379cf70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:20.783144 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b32ee04f-376a-45a2-be8f-5dfd3379cf70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:20.784748 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b32ee04f-376a-45a2-be8f-5dfd3379cf70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:20.786052 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b32ee04f-376a-45a2-be8f-5dfd3379cf70 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.181201 Nov 23 07:46:20.786615 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 281/536] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:20 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:21.237661 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-11bde250-14d9-4d49-b149-af9ea74bd558 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:21.238743 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-11bde250-14d9-4d49-b149-af9ea74bd558 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:21.245602 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-11bde250-14d9-4d49-b149-af9ea74bd558 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:21.246335 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-11bde250-14d9-4d49-b149-af9ea74bd558 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:21.247285 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-11bde250-14d9-4d49-b149-af9ea74bd558 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:21.251992 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-11bde250-14d9-4d49-b149-af9ea74bd558 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:21.402175 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-11bde250-14d9-4d49-b149-af9ea74bd558 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:21.411205 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-11bde250-14d9-4d49-b149-af9ea74bd558 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1556 microversion: 2.1 time: 0.177728 Nov 23 07:46:21.422233 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 256/537] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:21 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1556 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:21.490615 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ff93003f-c339-414e-bd31-3dcd3c8a493a tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:21.492922 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ff93003f-c339-414e-bd31-3dcd3c8a493a tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:21.503392 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ff93003f-c339-414e-bd31-3dcd3c8a493a tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:21.503982 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ff93003f-c339-414e-bd31-3dcd3c8a493a tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:21.504821 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ff93003f-c339-414e-bd31-3dcd3c8a493a tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:21.505361 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ff93003f-c339-414e-bd31-3dcd3c8a493a tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:21.646926 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ff93003f-c339-414e-bd31-3dcd3c8a493a tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:21.655213 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ff93003f-c339-414e-bd31-3dcd3c8a493a tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1512 microversion: 2.1 time: 0.169693 Nov 23 07:46:21.655816 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 282/538] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:21 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:21.806705 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-8d262e47-6024-42cb-a080-a8005201e9c5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:21.807304 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-8d262e47-6024-42cb-a080-a8005201e9c5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:21.813398 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8d262e47-6024-42cb-a080-a8005201e9c5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:21.813896 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8d262e47-6024-42cb-a080-a8005201e9c5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:21.814873 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8d262e47-6024-42cb-a080-a8005201e9c5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:21.815335 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8d262e47-6024-42cb-a080-a8005201e9c5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:21.949819 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-8d262e47-6024-42cb-a080-a8005201e9c5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:21.959143 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-8d262e47-6024-42cb-a080-a8005201e9c5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:21.961158 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-8d262e47-6024-42cb-a080-a8005201e9c5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:21.962350 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-8d262e47-6024-42cb-a080-a8005201e9c5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.160141 Nov 23 07:46:21.963106 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 257/539] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:21 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:22.430749 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-34222d09-88b0-4ee0-a2b8-35ccc0dc69cb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:22.431264 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-34222d09-88b0-4ee0-a2b8-35ccc0dc69cb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:22.437295 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-34222d09-88b0-4ee0-a2b8-35ccc0dc69cb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:22.437884 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-34222d09-88b0-4ee0-a2b8-35ccc0dc69cb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:22.438696 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-34222d09-88b0-4ee0-a2b8-35ccc0dc69cb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:22.439130 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-34222d09-88b0-4ee0-a2b8-35ccc0dc69cb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:22.627276 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-34222d09-88b0-4ee0-a2b8-35ccc0dc69cb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:22.640684 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-34222d09-88b0-4ee0-a2b8-35ccc0dc69cb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1556 microversion: 2.1 time: 0.213179 Nov 23 07:46:22.657817 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 283/540] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:22 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1556 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:22.675408 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-7e646069-ed15-4408-82e7-f9082a17c589 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:22.676099 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-7e646069-ed15-4408-82e7-f9082a17c589 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:22.685180 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7e646069-ed15-4408-82e7-f9082a17c589 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:22.685544 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7e646069-ed15-4408-82e7-f9082a17c589 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:22.686364 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7e646069-ed15-4408-82e7-f9082a17c589 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:22.686790 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7e646069-ed15-4408-82e7-f9082a17c589 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:22.830542 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-7e646069-ed15-4408-82e7-f9082a17c589 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:22.838819 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-7e646069-ed15-4408-82e7-f9082a17c589 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1512 microversion: 2.1 time: 0.167260 Nov 23 07:46:22.839719 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 258/541] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:22 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:46:22.980247 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-428c338f-2ad9-4ee8-b246-9f38f78dcc0a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:22.980850 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-428c338f-2ad9-4ee8-b246-9f38f78dcc0a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:22.986847 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-428c338f-2ad9-4ee8-b246-9f38f78dcc0a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:22.987294 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-428c338f-2ad9-4ee8-b246-9f38f78dcc0a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:22.988075 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-428c338f-2ad9-4ee8-b246-9f38f78dcc0a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:22.988506 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-428c338f-2ad9-4ee8-b246-9f38f78dcc0a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:23.125674 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-428c338f-2ad9-4ee8-b246-9f38f78dcc0a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:23.134361 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-428c338f-2ad9-4ee8-b246-9f38f78dcc0a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:23.135869 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-428c338f-2ad9-4ee8-b246-9f38f78dcc0a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:23.137030 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-428c338f-2ad9-4ee8-b246-9f38f78dcc0a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.160488 Nov 23 07:46:23.142300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 284/542] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:22 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:23.665097 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f91600b7-ab32-4ca3-9571-3e697708e2f0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:23.665631 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f91600b7-ab32-4ca3-9571-3e697708e2f0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:23.672183 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f91600b7-ab32-4ca3-9571-3e697708e2f0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:23.672598 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f91600b7-ab32-4ca3-9571-3e697708e2f0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:23.673390 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f91600b7-ab32-4ca3-9571-3e697708e2f0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:23.673859 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f91600b7-ab32-4ca3-9571-3e697708e2f0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:23.852101 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f91600b7-ab32-4ca3-9571-3e697708e2f0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:23.857813 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c65731d5-514f-42a1-aabd-e06fb84a1382 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:23.858424 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c65731d5-514f-42a1-aabd-e06fb84a1382 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:23.861017 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f91600b7-ab32-4ca3-9571-3e697708e2f0 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1556 microversion: 2.1 time: 0.200594 Nov 23 07:46:23.862037 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 259/543] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:23 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1556 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:23.865277 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c65731d5-514f-42a1-aabd-e06fb84a1382 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:23.865748 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c65731d5-514f-42a1-aabd-e06fb84a1382 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:23.867667 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c65731d5-514f-42a1-aabd-e06fb84a1382 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:23.868260 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c65731d5-514f-42a1-aabd-e06fb84a1382 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:24.006724 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-c65731d5-514f-42a1-aabd-e06fb84a1382 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:24.014408 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c65731d5-514f-42a1-aabd-e06fb84a1382 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1512 microversion: 2.1 time: 0.160102 Nov 23 07:46:24.014985 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 285/544] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:23 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:46:24.155667 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5a252a1b-437e-4952-9aad-4185e99f9067 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:24.156278 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5a252a1b-437e-4952-9aad-4185e99f9067 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:24.164392 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5a252a1b-437e-4952-9aad-4185e99f9067 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:24.164836 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5a252a1b-437e-4952-9aad-4185e99f9067 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:24.165654 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5a252a1b-437e-4952-9aad-4185e99f9067 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:24.166109 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5a252a1b-437e-4952-9aad-4185e99f9067 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:24.306399 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5a252a1b-437e-4952-9aad-4185e99f9067 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:24.316041 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5a252a1b-437e-4952-9aad-4185e99f9067 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:24.317596 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5a252a1b-437e-4952-9aad-4185e99f9067 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:24.319226 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5a252a1b-437e-4952-9aad-4185e99f9067 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.167374 Nov 23 07:46:24.319805 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 260/545] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:24 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:24.878687 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-57f7bff2-ecb9-4fa9-bfaa-095799867308 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:24.880099 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-57f7bff2-ecb9-4fa9-bfaa-095799867308 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:24.887069 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-57f7bff2-ecb9-4fa9-bfaa-095799867308 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:24.887817 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-57f7bff2-ecb9-4fa9-bfaa-095799867308 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:24.889913 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-57f7bff2-ecb9-4fa9-bfaa-095799867308 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:24.890563 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-57f7bff2-ecb9-4fa9-bfaa-095799867308 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:25.031677 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-fa9b3750-cb7d-47b9-b53f-e839bedc416b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:25.032312 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-fa9b3750-cb7d-47b9-b53f-e839bedc416b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:25.044757 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fa9b3750-cb7d-47b9-b53f-e839bedc416b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:25.044993 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fa9b3750-cb7d-47b9-b53f-e839bedc416b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:25.045625 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fa9b3750-cb7d-47b9-b53f-e839bedc416b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:25.046097 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fa9b3750-cb7d-47b9-b53f-e839bedc416b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:25.169888 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-57f7bff2-ecb9-4fa9-bfaa-095799867308 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:25.178228 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-57f7bff2-ecb9-4fa9-bfaa-095799867308 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1556 microversion: 2.1 time: 0.303044 Nov 23 07:46:25.179448 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 286/546] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:24 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1556 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:25.232395 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-fa9b3750-cb7d-47b9-b53f-e839bedc416b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:25.240121 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-fa9b3750-cb7d-47b9-b53f-e839bedc416b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1512 microversion: 2.1 time: 0.212043 Nov 23 07:46:25.240688 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 261/547] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:25 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1512 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:25.336076 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-590ecb5f-5932-47ff-88a6-ac992956c8e8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:25.337085 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-590ecb5f-5932-47ff-88a6-ac992956c8e8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:25.344464 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-590ecb5f-5932-47ff-88a6-ac992956c8e8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:25.344912 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-590ecb5f-5932-47ff-88a6-ac992956c8e8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:25.345919 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-590ecb5f-5932-47ff-88a6-ac992956c8e8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:25.346355 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-590ecb5f-5932-47ff-88a6-ac992956c8e8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:25.557747 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-590ecb5f-5932-47ff-88a6-ac992956c8e8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:25.567827 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-590ecb5f-5932-47ff-88a6-ac992956c8e8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:25.569620 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-590ecb5f-5932-47ff-88a6-ac992956c8e8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:25.571181 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-590ecb5f-5932-47ff-88a6-ac992956c8e8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.238831 Nov 23 07:46:25.571745 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 287/548] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:25 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:26.196672 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c0bd331d-077f-40d5-8014-70aecc8038b8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:26.197228 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c0bd331d-077f-40d5-8014-70aecc8038b8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:26.203464 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c0bd331d-077f-40d5-8014-70aecc8038b8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:26.203912 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c0bd331d-077f-40d5-8014-70aecc8038b8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:26.204677 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c0bd331d-077f-40d5-8014-70aecc8038b8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:26.205127 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c0bd331d-077f-40d5-8014-70aecc8038b8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:26.257942 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-93090311-1be1-447d-b675-6157808486b1 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:26.258569 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-93090311-1be1-447d-b675-6157808486b1 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:26.265090 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-93090311-1be1-447d-b675-6157808486b1 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:26.265546 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-93090311-1be1-447d-b675-6157808486b1 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:26.266388 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-93090311-1be1-447d-b675-6157808486b1 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:26.266829 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-93090311-1be1-447d-b675-6157808486b1 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:26.403438 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-93090311-1be1-447d-b675-6157808486b1 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:26.411191 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-93090311-1be1-447d-b675-6157808486b1 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1512 microversion: 2.1 time: 0.157377 Nov 23 07:46:26.411899 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 288/549] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:26 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:46:26.588623 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-218a492d-caa4-4fa1-9c86-833e71562637 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:26.589227 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-218a492d-caa4-4fa1-9c86-833e71562637 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:26.595121 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-218a492d-caa4-4fa1-9c86-833e71562637 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:26.595569 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-218a492d-caa4-4fa1-9c86-833e71562637 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:26.596347 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-218a492d-caa4-4fa1-9c86-833e71562637 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:26.596781 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-218a492d-caa4-4fa1-9c86-833e71562637 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:26.648017 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c0bd331d-077f-40d5-8014-70aecc8038b8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:26.655823 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c0bd331d-077f-40d5-8014-70aecc8038b8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1556 microversion: 2.1 time: 0.463266 Nov 23 07:46:26.656411 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 262/550] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:26 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1556 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:26.732038 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-218a492d-caa4-4fa1-9c86-833e71562637 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:26.740049 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-218a492d-caa4-4fa1-9c86-833e71562637 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:26.741556 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-218a492d-caa4-4fa1-9c86-833e71562637 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:26.742719 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-218a492d-caa4-4fa1-9c86-833e71562637 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.158345 Nov 23 07:46:26.743274 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 289/551] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:26 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:46:27.429861 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-a3f62c6f-c47a-4226-ba6b-a5bc6b2288ca tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:27.430398 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-a3f62c6f-c47a-4226-ba6b-a5bc6b2288ca tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:27.436554 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a3f62c6f-c47a-4226-ba6b-a5bc6b2288ca tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:27.436996 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a3f62c6f-c47a-4226-ba6b-a5bc6b2288ca tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:27.437796 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a3f62c6f-c47a-4226-ba6b-a5bc6b2288ca tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:27.438227 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a3f62c6f-c47a-4226-ba6b-a5bc6b2288ca tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:27.565751 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a3f62c6f-c47a-4226-ba6b-a5bc6b2288ca tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:27.573265 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-a3f62c6f-c47a-4226-ba6b-a5bc6b2288ca tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1512 microversion: 2.1 time: 0.147642 Nov 23 07:46:27.573865 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 263/552] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:27 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:27.674008 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a234541a-e337-4b54-814e-977ce2672f35 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:27.674607 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a234541a-e337-4b54-814e-977ce2672f35 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:27.680882 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a234541a-e337-4b54-814e-977ce2672f35 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:27.681257 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a234541a-e337-4b54-814e-977ce2672f35 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:27.682054 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a234541a-e337-4b54-814e-977ce2672f35 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:27.682482 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a234541a-e337-4b54-814e-977ce2672f35 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:27.765298 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-a6160a0a-52ed-4c2e-80f9-da96d37bf253 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:27.766353 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-a6160a0a-52ed-4c2e-80f9-da96d37bf253 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:27.773855 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a6160a0a-52ed-4c2e-80f9-da96d37bf253 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:27.774600 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a6160a0a-52ed-4c2e-80f9-da96d37bf253 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:27.775817 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a6160a0a-52ed-4c2e-80f9-da96d37bf253 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:27.776456 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a6160a0a-52ed-4c2e-80f9-da96d37bf253 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:27.830040 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a234541a-e337-4b54-814e-977ce2672f35 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:27.839864 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a234541a-e337-4b54-814e-977ce2672f35 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1556 microversion: 2.1 time: 0.169592 Nov 23 07:46:27.840448 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 290/553] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:27 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:27.982049 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a6160a0a-52ed-4c2e-80f9-da96d37bf253 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:27.990504 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a6160a0a-52ed-4c2e-80f9-da96d37bf253 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:27.992503 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a6160a0a-52ed-4c2e-80f9-da96d37bf253 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:27.993743 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-a6160a0a-52ed-4c2e-80f9-da96d37bf253 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.236934 Nov 23 07:46:27.994316 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 264/554] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:27 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:28.302967 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-50b117cf-70ef-4ed0-93d2-ba39ab8ff082 req-60d5dc58-c18b-4d70-9757-ab943cf20c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "732e1298-1293-4cb3-833a-264392fb9ddf", "name": "network-vif-deleted", "tag": "b729e24f-17fa-4c4d-a210-3cb40b8aa4a8"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:46:28.305949 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:46:28.305949 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:46:28.313710 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-50b117cf-70ef-4ed0-93d2-ba39ab8ff082 req-60d5dc58-c18b-4d70-9757-ab943cf20c2e service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:28.314215 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-50b117cf-70ef-4ed0-93d2-ba39ab8ff082 req-60d5dc58-c18b-4d70-9757-ab943cf20c2e service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:28.327163 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-50b117cf-70ef-4ed0-93d2-ba39ab8ff082 req-60d5dc58-c18b-4d70-9757-ab943cf20c2e service nova] Creating event network-vif-deleted:b729e24f-17fa-4c4d-a210-3cb40b8aa4a8 for instance 732e1298-1293-4cb3-833a-264392fb9ddf on hv-cinder-80403 Nov 23 07:46:28.332301 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-50b117cf-70ef-4ed0-93d2-ba39ab8ff082 req-60d5dc58-c18b-4d70-9757-ab943cf20c2e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036858 Nov 23 07:46:28.332919 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 291/555] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:46:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:46:28.589893 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-93b67a2c-85ea-4630-9ceb-1c1c93dc1492 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:28.590557 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-93b67a2c-85ea-4630-9ceb-1c1c93dc1492 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:28.596796 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-93b67a2c-85ea-4630-9ceb-1c1c93dc1492 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:28.597241 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-93b67a2c-85ea-4630-9ceb-1c1c93dc1492 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:28.598182 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-93b67a2c-85ea-4630-9ceb-1c1c93dc1492 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:28.598623 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-93b67a2c-85ea-4630-9ceb-1c1c93dc1492 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:28.630717 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-93b67a2c-85ea-4630-9ceb-1c1c93dc1492 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:28.631155 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-93b67a2c-85ea-4630-9ceb-1c1c93dc1492 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:28.631604 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.objects.instance [None req-93b67a2c-85ea-4630-9ceb-1c1c93dc1492 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lazy-loading 'fault' on Instance uuid 732e1298-1293-4cb3-833a-264392fb9ddf {{(pid=122785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:46:28.670381 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-93b67a2c-85ea-4630-9ceb-1c1c93dc1492 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:28.678318 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-93b67a2c-85ea-4630-9ceb-1c1c93dc1492 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 200 len: 1308 microversion: 2.1 time: 0.092036 Nov 23 07:46:28.679563 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 265/556] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:28 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:28.857333 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8f0de8a8-f1f3-46fb-877c-46a631192e44 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:28.857997 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8f0de8a8-f1f3-46fb-877c-46a631192e44 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:28.864388 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8f0de8a8-f1f3-46fb-877c-46a631192e44 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:28.864837 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8f0de8a8-f1f3-46fb-877c-46a631192e44 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:28.865606 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8f0de8a8-f1f3-46fb-877c-46a631192e44 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:28.866067 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8f0de8a8-f1f3-46fb-877c-46a631192e44 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:28.994429 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-8f0de8a8-f1f3-46fb-877c-46a631192e44 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:29.002099 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-8f0de8a8-f1f3-46fb-877c-46a631192e44 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1562 microversion: 2.1 time: 0.148890 Nov 23 07:46:29.002661 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 292/557] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:28 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:29.011728 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-2b79fd1d-380a-40cb-a139-73e2b895c8bb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:29.012363 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-2b79fd1d-380a-40cb-a139-73e2b895c8bb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:29.018239 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2b79fd1d-380a-40cb-a139-73e2b895c8bb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:29.018681 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2b79fd1d-380a-40cb-a139-73e2b895c8bb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:29.019449 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2b79fd1d-380a-40cb-a139-73e2b895c8bb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:29.019881 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2b79fd1d-380a-40cb-a139-73e2b895c8bb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:29.068729 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-eee5edd9-5dc2-47c3-a0ee-6b783621807f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:29.069243 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-eee5edd9-5dc2-47c3-a0ee-6b783621807f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:29.075018 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-eee5edd9-5dc2-47c3-a0ee-6b783621807f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:29.076098 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-eee5edd9-5dc2-47c3-a0ee-6b783621807f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:29.076912 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-eee5edd9-5dc2-47c3-a0ee-6b783621807f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:29.077335 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-eee5edd9-5dc2-47c3-a0ee-6b783621807f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:29.156591 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-2b79fd1d-380a-40cb-a139-73e2b895c8bb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:29.156764 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.objects.instance [None req-eee5edd9-5dc2-47c3-a0ee-6b783621807f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lazy-loading 'services' on Instance uuid c5cba5f7-c9fd-4708-923c-deec6ab27cdd {{(pid=122786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:46:29.165084 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-2b79fd1d-380a-40cb-a139-73e2b895c8bb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:29.166613 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-2b79fd1d-380a-40cb-a139-73e2b895c8bb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:29.167767 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-2b79fd1d-380a-40cb-a139-73e2b895c8bb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.159803 Nov 23 07:46:29.168329 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 266/558] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:29 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:29.265161 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-eee5edd9-5dc2-47c3-a0ee-6b783621807f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/os-volume_attachments/d3e0bbd4-ce1e-4b68-b50e-bc909648fd36" status: 202 len: 0 microversion: 2.1 time: 0.199952 Nov 23 07:46:29.265898 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 293/559] 10.222.0.48 () {58 vars in 1415 bytes} [Tue Nov 23 07:46:29 2021] DELETE /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/os-volume_attachments/d3e0bbd4-ce1e-4b68-b50e-bc909648fd36 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:46:29.274653 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3562b278-0395-4e99-830d-006cc6033cd2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:29.275755 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3562b278-0395-4e99-830d-006cc6033cd2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:29.281671 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3562b278-0395-4e99-830d-006cc6033cd2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:29.282268 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3562b278-0395-4e99-830d-006cc6033cd2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:29.283060 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3562b278-0395-4e99-830d-006cc6033cd2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:29.283737 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3562b278-0395-4e99-830d-006cc6033cd2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:29.313856 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3562b278-0395-4e99-830d-006cc6033cd2 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043429 Nov 23 07:46:29.314653 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 267/560] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:46:29 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:46:29.697309 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-cd230885-23d0-4dcd-b4a0-4dcb2fa088b2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:29.697955 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-cd230885-23d0-4dcd-b4a0-4dcb2fa088b2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 732e1298-1293-4cb3-833a-264392fb9ddf] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:29.704201 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cd230885-23d0-4dcd-b4a0-4dcb2fa088b2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:29.704646 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cd230885-23d0-4dcd-b4a0-4dcb2fa088b2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:29.705414 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cd230885-23d0-4dcd-b4a0-4dcb2fa088b2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:29.705882 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cd230885-23d0-4dcd-b4a0-4dcb2fa088b2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:29.718778 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-cd230885-23d0-4dcd-b4a0-4dcb2fa088b2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] HTTP exception thrown: Instance 732e1298-1293-4cb3-833a-264392fb9ddf could not be found. Nov 23 07:46:29.719800 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-cd230885-23d0-4dcd-b4a0-4dcb2fa088b2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Returning 404 to user: Instance 732e1298-1293-4cb3-833a-264392fb9ddf could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:46:29.720638 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-cd230885-23d0-4dcd-b4a0-4dcb2fa088b2 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf" status: 404 len: 111 microversion: 2.1 time: 0.028043 Nov 23 07:46:29.721328 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 294/561] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:29 2021] GET /compute/v2.1/servers/732e1298-1293-4cb3-833a-264392fb9ddf => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:46:30.185673 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ed73686a-e914-47bc-9daf-793379334b62 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:30.186293 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ed73686a-e914-47bc-9daf-793379334b62 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:30.192842 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ed73686a-e914-47bc-9daf-793379334b62 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:30.193289 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ed73686a-e914-47bc-9daf-793379334b62 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:30.194106 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ed73686a-e914-47bc-9daf-793379334b62 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:30.194535 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ed73686a-e914-47bc-9daf-793379334b62 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:30.322114 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ed73686a-e914-47bc-9daf-793379334b62 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:30.325396 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8f9be98a-23ca-4b7b-a46d-df0e7ec5d5c8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:30.326357 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8f9be98a-23ca-4b7b-a46d-df0e7ec5d5c8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:30.330482 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ed73686a-e914-47bc-9daf-793379334b62 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:30.331975 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ed73686a-e914-47bc-9daf-793379334b62 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:30.332472 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8f9be98a-23ca-4b7b-a46d-df0e7ec5d5c8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:30.332915 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8f9be98a-23ca-4b7b-a46d-df0e7ec5d5c8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:30.333113 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ed73686a-e914-47bc-9daf-793379334b62 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.151213 Nov 23 07:46:30.333682 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8f9be98a-23ca-4b7b-a46d-df0e7ec5d5c8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:30.333833 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 268/562] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:30 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:30.334132 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8f9be98a-23ca-4b7b-a46d-df0e7ec5d5c8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:30.363406 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-8f9be98a-23ca-4b7b-a46d-df0e7ec5d5c8 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041764 Nov 23 07:46:30.363950 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 295/563] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:46:30 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 07:46:31.351693 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d9356383-a663-42e8-a056-c97ca23a3bca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:31.352293 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d9356383-a663-42e8-a056-c97ca23a3bca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:31.358564 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d9356383-a663-42e8-a056-c97ca23a3bca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:31.359005 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d9356383-a663-42e8-a056-c97ca23a3bca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:31.359765 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d9356383-a663-42e8-a056-c97ca23a3bca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:31.360195 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d9356383-a663-42e8-a056-c97ca23a3bca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:31.490247 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d9356383-a663-42e8-a056-c97ca23a3bca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:31.499219 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d9356383-a663-42e8-a056-c97ca23a3bca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:31.500706 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d9356383-a663-42e8-a056-c97ca23a3bca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:31.501882 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d9356383-a663-42e8-a056-c97ca23a3bca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.154424 Nov 23 07:46:31.502461 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 269/564] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:31 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:32.520637 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-9bb6dac6-39a3-44a1-9a33-ee69d9d1923a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:32.521224 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-9bb6dac6-39a3-44a1-9a33-ee69d9d1923a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:32.526982 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9bb6dac6-39a3-44a1-9a33-ee69d9d1923a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:32.527423 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9bb6dac6-39a3-44a1-9a33-ee69d9d1923a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:32.528186 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9bb6dac6-39a3-44a1-9a33-ee69d9d1923a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:32.528610 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9bb6dac6-39a3-44a1-9a33-ee69d9d1923a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:32.659665 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-9bb6dac6-39a3-44a1-9a33-ee69d9d1923a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:32.670653 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-9bb6dac6-39a3-44a1-9a33-ee69d9d1923a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:32.672382 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-9bb6dac6-39a3-44a1-9a33-ee69d9d1923a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:32.673572 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-9bb6dac6-39a3-44a1-9a33-ee69d9d1923a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.157181 Nov 23 07:46:32.674167 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 296/565] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:32 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:33.695351 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d537e21b-18d7-4755-9ef2-0c7de2d465e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:33.697098 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d537e21b-18d7-4755-9ef2-0c7de2d465e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:33.705376 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d537e21b-18d7-4755-9ef2-0c7de2d465e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:33.706360 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d537e21b-18d7-4755-9ef2-0c7de2d465e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:33.707543 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d537e21b-18d7-4755-9ef2-0c7de2d465e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:33.708278 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d537e21b-18d7-4755-9ef2-0c7de2d465e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:33.856315 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d537e21b-18d7-4755-9ef2-0c7de2d465e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:33.865066 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d537e21b-18d7-4755-9ef2-0c7de2d465e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:33.867150 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d537e21b-18d7-4755-9ef2-0c7de2d465e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:33.868509 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d537e21b-18d7-4755-9ef2-0c7de2d465e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.179537 Nov 23 07:46:33.869262 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 270/566] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:33 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:34.755229 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c543e632-9478-464d-9293-364ecb42f95f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:34.755750 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c543e632-9478-464d-9293-364ecb42f95f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:34.762635 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c543e632-9478-464d-9293-364ecb42f95f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:34.763079 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c543e632-9478-464d-9293-364ecb42f95f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:34.763872 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c543e632-9478-464d-9293-364ecb42f95f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:34.764300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c543e632-9478-464d-9293-364ecb42f95f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:34.788621 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c543e632-9478-464d-9293-364ecb42f95f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Going to try to terminate instance {{(pid=122786) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:46:34.863286 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c543e632-9478-464d-9293-364ecb42f95f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 204 len: 0 microversion: 2.1 time: 0.111422 Nov 23 07:46:34.863874 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 297/567] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:46:34 2021] DELETE /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 07:46:34.873630 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ab3683f2-cbd6-4529-a93e-173fa619716f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:34.874834 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ab3683f2-cbd6-4529-a93e-173fa619716f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:34.882048 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ab3683f2-cbd6-4529-a93e-173fa619716f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:34.882501 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ab3683f2-cbd6-4529-a93e-173fa619716f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:34.883312 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ab3683f2-cbd6-4529-a93e-173fa619716f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:34.883742 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ab3683f2-cbd6-4529-a93e-173fa619716f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:34.887800 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-2346623e-045a-4817-8f63-b21f8f7c22e2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:34.888534 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-2346623e-045a-4817-8f63-b21f8f7c22e2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:34.894301 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2346623e-045a-4817-8f63-b21f8f7c22e2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:34.894754 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2346623e-045a-4817-8f63-b21f8f7c22e2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:34.895524 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2346623e-045a-4817-8f63-b21f8f7c22e2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:34.895953 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2346623e-045a-4817-8f63-b21f8f7c22e2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:35.019454 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ab3683f2-cbd6-4529-a93e-173fa619716f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:35.027887 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ab3683f2-cbd6-4529-a93e-173fa619716f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1507 microversion: 2.1 time: 0.159160 Nov 23 07:46:35.037859 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 271/568] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:34 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:35.038055 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2346623e-045a-4817-8f63-b21f8f7c22e2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:35.039196 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2346623e-045a-4817-8f63-b21f8f7c22e2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:35.040685 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2346623e-045a-4817-8f63-b21f8f7c22e2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:35.041879 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-2346623e-045a-4817-8f63-b21f8f7c22e2 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.158184 Nov 23 07:46:35.042446 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 298/569] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:34 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:46:36.045478 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-1242b811-adb4-4807-ba22-aec064ef0a9d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:36.046117 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-1242b811-adb4-4807-ba22-aec064ef0a9d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:36.052349 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1242b811-adb4-4807-ba22-aec064ef0a9d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:36.052800 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1242b811-adb4-4807-ba22-aec064ef0a9d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:36.053577 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1242b811-adb4-4807-ba22-aec064ef0a9d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:36.054049 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1242b811-adb4-4807-ba22-aec064ef0a9d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:36.059542 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-916bceb8-8c74-48d0-bc1e-2f82272d88a7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:36.060146 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-916bceb8-8c74-48d0-bc1e-2f82272d88a7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:36.066644 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-916bceb8-8c74-48d0-bc1e-2f82272d88a7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:36.066999 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-916bceb8-8c74-48d0-bc1e-2f82272d88a7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:36.067780 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-916bceb8-8c74-48d0-bc1e-2f82272d88a7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:36.068277 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-916bceb8-8c74-48d0-bc1e-2f82272d88a7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:36.188385 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-1242b811-adb4-4807-ba22-aec064ef0a9d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:36.196972 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-1242b811-adb4-4807-ba22-aec064ef0a9d tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1507 microversion: 2.1 time: 0.155107 Nov 23 07:46:36.197566 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 272/570] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:36 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:36.210796 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-916bceb8-8c74-48d0-bc1e-2f82272d88a7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:36.218905 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-916bceb8-8c74-48d0-bc1e-2f82272d88a7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:36.220390 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-916bceb8-8c74-48d0-bc1e-2f82272d88a7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:36.221538 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-916bceb8-8c74-48d0-bc1e-2f82272d88a7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.165680 Nov 23 07:46:36.222140 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 299/571] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:36 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:46:36.383309 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 07:46:36.383484 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: Tue Nov 23 07:46:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 07:46:36.638937 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-4948a9f9-3e57-42ac-a27f-7ca2f1cf7785 req-9de78648-8c0e-4a91-b5b7-25903d4299a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb841a35-6344-43a0-85d2-6de8116759b1", "name": "network-vif-plugged", "status": "completed", "tag": "8b4fce4b-5f2b-4eea-8335-5d57ac70511e"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:46:36.640485 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:46:36.640485 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:46:36.647569 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-4948a9f9-3e57-42ac-a27f-7ca2f1cf7785 req-9de78648-8c0e-4a91-b5b7-25903d4299a6 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:36.647925 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-4948a9f9-3e57-42ac-a27f-7ca2f1cf7785 req-9de78648-8c0e-4a91-b5b7-25903d4299a6 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:36.659076 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-4948a9f9-3e57-42ac-a27f-7ca2f1cf7785 req-9de78648-8c0e-4a91-b5b7-25903d4299a6 service nova] Creating event network-vif-plugged:8b4fce4b-5f2b-4eea-8335-5d57ac70511e for instance bb841a35-6344-43a0-85d2-6de8116759b1 on hv-cinder-80403 Nov 23 07:46:36.664964 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-4948a9f9-3e57-42ac-a27f-7ca2f1cf7785 req-9de78648-8c0e-4a91-b5b7-25903d4299a6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029725 Nov 23 07:46:36.665576 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 273/572] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:46:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:46:37.214108 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-0ba125f9-2fc5-4ab4-9ad9-a9371502b761 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:37.214727 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-0ba125f9-2fc5-4ab4-9ad9-a9371502b761 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:37.220921 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0ba125f9-2fc5-4ab4-9ad9-a9371502b761 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:37.221372 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0ba125f9-2fc5-4ab4-9ad9-a9371502b761 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:37.222177 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0ba125f9-2fc5-4ab4-9ad9-a9371502b761 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:37.222614 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0ba125f9-2fc5-4ab4-9ad9-a9371502b761 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:37.240724 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3caff991-e085-4266-8065-a6476f0a68e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:37.241425 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3caff991-e085-4266-8065-a6476f0a68e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:37.247466 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3caff991-e085-4266-8065-a6476f0a68e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:37.247911 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3caff991-e085-4266-8065-a6476f0a68e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:37.248689 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3caff991-e085-4266-8065-a6476f0a68e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:37.249125 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3caff991-e085-4266-8065-a6476f0a68e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:37.360066 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-0ba125f9-2fc5-4ab4-9ad9-a9371502b761 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:37.367933 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-0ba125f9-2fc5-4ab4-9ad9-a9371502b761 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1507 microversion: 2.1 time: 0.157433 Nov 23 07:46:37.368584 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 300/573] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:37 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:37.379855 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-3caff991-e085-4266-8065-a6476f0a68e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:37.389083 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-3caff991-e085-4266-8065-a6476f0a68e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:37.390764 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-3caff991-e085-4266-8065-a6476f0a68e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:37.391913 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3caff991-e085-4266-8065-a6476f0a68e5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.155678 Nov 23 07:46:37.392708 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 274/574] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:37 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:46:38.384109 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-193aec1b-1961-42e5-b66f-6a0fecfaddff tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:38.384744 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-193aec1b-1961-42e5-b66f-6a0fecfaddff tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:38.391889 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-193aec1b-1961-42e5-b66f-6a0fecfaddff tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:38.392331 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-193aec1b-1961-42e5-b66f-6a0fecfaddff tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:38.393094 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-193aec1b-1961-42e5-b66f-6a0fecfaddff tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:38.393522 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-193aec1b-1961-42e5-b66f-6a0fecfaddff tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:38.411157 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-cd056fa8-2d8d-4063-b91c-6375b69a51cc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:38.411812 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-cd056fa8-2d8d-4063-b91c-6375b69a51cc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:38.419562 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cd056fa8-2d8d-4063-b91c-6375b69a51cc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:38.419907 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cd056fa8-2d8d-4063-b91c-6375b69a51cc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:38.420680 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cd056fa8-2d8d-4063-b91c-6375b69a51cc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:38.421107 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cd056fa8-2d8d-4063-b91c-6375b69a51cc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:38.529927 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-193aec1b-1961-42e5-b66f-6a0fecfaddff tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:38.538561 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-193aec1b-1961-42e5-b66f-6a0fecfaddff tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1507 microversion: 2.1 time: 0.157169 Nov 23 07:46:38.539165 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 301/575] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:38 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:38.559806 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-cd056fa8-2d8d-4063-b91c-6375b69a51cc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:38.567977 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-cd056fa8-2d8d-4063-b91c-6375b69a51cc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:38.569520 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-cd056fa8-2d8d-4063-b91c-6375b69a51cc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:38.570699 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-cd056fa8-2d8d-4063-b91c-6375b69a51cc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.163896 Nov 23 07:46:38.571248 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 275/576] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:38 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:39.547630 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8d02dfad-5a8a-4243-a801-4cb32cb1a973 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-935632915", "imageRef": "6895b3b6-16b9-4e43-bf1b-c19e73615ca8", "flavorRef": "452", "networks": [{"uuid": "3750312f-10a6-44d3-9b74-d5b95bc5fc19"}]}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:46:39.555986 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-42b0c209-8902-464f-8f2e-b07b70e782bb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:39.556744 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-42b0c209-8902-464f-8f2e-b07b70e782bb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:39.564019 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-42b0c209-8902-464f-8f2e-b07b70e782bb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:39.564558 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-42b0c209-8902-464f-8f2e-b07b70e782bb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:39.565550 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-42b0c209-8902-464f-8f2e-b07b70e782bb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:39.566500 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-42b0c209-8902-464f-8f2e-b07b70e782bb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:39.601359 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.network.neutron [None req-8d02dfad-5a8a-4243-a801-4cb32cb1a973 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] validate_networks() for [('3750312f-10a6-44d3-9b74-d5b95bc5fc19', None, None, None, None, None)] {{(pid=122786) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:46:39.779710 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-42b0c209-8902-464f-8f2e-b07b70e782bb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:39.787050 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-42b0c209-8902-464f-8f2e-b07b70e782bb tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1507 microversion: 2.1 time: 0.235375 Nov 23 07:46:39.788786 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 276/577] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:39 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1507 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:46:39.794308 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-06782574-e0a0-4ae3-9192-4328150b1c0b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:39.795220 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-06782574-e0a0-4ae3-9192-4328150b1c0b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:39.802697 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-06782574-e0a0-4ae3-9192-4328150b1c0b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:39.804815 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-06782574-e0a0-4ae3-9192-4328150b1c0b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:39.805742 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-06782574-e0a0-4ae3-9192-4328150b1c0b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:39.806356 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-06782574-e0a0-4ae3-9192-4328150b1c0b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:39.960938 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-8d02dfad-5a8a-4243-a801-4cb32cb1a973 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Flavor limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:46:39.961296 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-8d02dfad-5a8a-4243-a801-4cb32cb1a973 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Image limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:46:39.961795 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-8d02dfad-5a8a-4243-a801-4cb32cb1a973 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Flavor pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:46:39.962199 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-8d02dfad-5a8a-4243-a801-4cb32cb1a973 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Image pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:46:39.962604 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-8d02dfad-5a8a-4243-a801-4cb32cb1a973 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:46:39.971180 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8d02dfad-5a8a-4243-a801-4cb32cb1a973 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:39.971624 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8d02dfad-5a8a-4243-a801-4cb32cb1a973 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:39.972426 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8d02dfad-5a8a-4243-a801-4cb32cb1a973 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:39.972857 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8d02dfad-5a8a-4243-a801-4cb32cb1a973 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:39.989709 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-8d02dfad-5a8a-4243-a801-4cb32cb1a973 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Getting quotas for project 230efaa941f948e5b6c183a252310eda. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:46:39.993770 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-8d02dfad-5a8a-4243-a801-4cb32cb1a973 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Getting quotas for user a82a3ef8b5604e208e028a5b0386c79f and project 230efaa941f948e5b6c183a252310eda. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:46:40.005773 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8d02dfad-5a8a-4243-a801-4cb32cb1a973 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Going to run 1 instances... {{(pid=122786) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:46:40.008164 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8d02dfad-5a8a-4243-a801-4cb32cb1a973 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 02f5ff24-8ac7-420f-b8ef-3b4d52919495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6895b3b6-16b9-4e43-bf1b-c19e73615ca8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:46:40.027293 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-06782574-e0a0-4ae3-9192-4328150b1c0b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:40.038649 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-06782574-e0a0-4ae3-9192-4328150b1c0b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:40.040851 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-06782574-e0a0-4ae3-9192-4328150b1c0b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:40.042514 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-06782574-e0a0-4ae3-9192-4328150b1c0b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.252455 Nov 23 07:46:40.043216 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 277/578] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:39 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:40.062592 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-8d02dfad-5a8a-4243-a801-4cb32cb1a973 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518493 Nov 23 07:46:40.063879 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 302/579] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Nov 23 07:46:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 07:46:40.095736 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-238e6668-ba8f-4246-9aaf-bcd3b49b8f62 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:40.096757 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-238e6668-ba8f-4246-9aaf-bcd3b49b8f62 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 02f5ff24-8ac7-420f-b8ef-3b4d52919495] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:40.132219 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-e9b7fdc6-f45e-4393-a636-4aff79513595 req-09a4f619-fc8a-48c5-b9fc-7dbf1e832ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9df126-b886-4cb5-88f0-20dc6e22dbe1", "name": "network-vif-deleted", "tag": "e60ee95d-4ae8-48a9-b92b-e6e28e265d71"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:46:40.134071 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:46:40.134071 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:46:40.141543 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-e9b7fdc6-f45e-4393-a636-4aff79513595 req-09a4f619-fc8a-48c5-b9fc-7dbf1e832ce6 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:40.142096 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-e9b7fdc6-f45e-4393-a636-4aff79513595 req-09a4f619-fc8a-48c5-b9fc-7dbf1e832ce6 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:40.171614 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-e9b7fdc6-f45e-4393-a636-4aff79513595 req-09a4f619-fc8a-48c5-b9fc-7dbf1e832ce6 service nova] Creating event network-vif-deleted:e60ee95d-4ae8-48a9-b92b-e6e28e265d71 for instance 6b9df126-b886-4cb5-88f0-20dc6e22dbe1 on hv-cinder-80403 Nov 23 07:46:40.188143 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-e9b7fdc6-f45e-4393-a636-4aff79513595 req-09a4f619-fc8a-48c5-b9fc-7dbf1e832ce6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059826 Nov 23 07:46:40.198522 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 303/580] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:46:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:46:40.205230 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-238e6668-ba8f-4246-9aaf-bcd3b49b8f62 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:40.212970 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-238e6668-ba8f-4246-9aaf-bcd3b49b8f62 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495" status: 200 len: 1218 microversion: 2.1 time: 0.132021 Nov 23 07:46:40.214479 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 278/581] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:40 2021] GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495 => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:40.806567 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-139eebfc-68b8-4641-ba69-b057c510cb26 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:40.807323 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-139eebfc-68b8-4641-ba69-b057c510cb26 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:40.834886 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-139eebfc-68b8-4641-ba69-b057c510cb26 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:40.835460 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-139eebfc-68b8-4641-ba69-b057c510cb26 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:40.836280 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-139eebfc-68b8-4641-ba69-b057c510cb26 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:40.836774 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-139eebfc-68b8-4641-ba69-b057c510cb26 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:40.871913 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-139eebfc-68b8-4641-ba69-b057c510cb26 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:40.872373 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-139eebfc-68b8-4641-ba69-b057c510cb26 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:40.872863 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.objects.instance [None req-139eebfc-68b8-4641-ba69-b057c510cb26 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lazy-loading 'fault' on Instance uuid 6b9df126-b886-4cb5-88f0-20dc6e22dbe1 {{(pid=122786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:46:40.919283 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-139eebfc-68b8-4641-ba69-b057c510cb26 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:40.926464 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-139eebfc-68b8-4641-ba69-b057c510cb26 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 200 len: 1311 microversion: 2.1 time: 0.124781 Nov 23 07:46:40.927046 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 304/582] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:40 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 1311 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:41.060503 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-1b837642-10b3-4a6d-803f-0f8e82dd1d36 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:41.061214 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-1b837642-10b3-4a6d-803f-0f8e82dd1d36 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:41.067618 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1b837642-10b3-4a6d-803f-0f8e82dd1d36 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:41.068061 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1b837642-10b3-4a6d-803f-0f8e82dd1d36 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:41.069413 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1b837642-10b3-4a6d-803f-0f8e82dd1d36 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:41.069875 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1b837642-10b3-4a6d-803f-0f8e82dd1d36 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:41.204108 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-1b837642-10b3-4a6d-803f-0f8e82dd1d36 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:41.214625 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-1b837642-10b3-4a6d-803f-0f8e82dd1d36 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:41.216123 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-1b837642-10b3-4a6d-803f-0f8e82dd1d36 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:41.217957 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-1b837642-10b3-4a6d-803f-0f8e82dd1d36 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1806 microversion: 2.20 time: 0.161267 Nov 23 07:46:41.218526 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 279/583] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:41 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:46:41.234316 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4ebb4154-6a7f-4138-bdff-e446c5c95bd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:41.235092 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4ebb4154-6a7f-4138-bdff-e446c5c95bd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 02f5ff24-8ac7-420f-b8ef-3b4d52919495] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:41.241797 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4ebb4154-6a7f-4138-bdff-e446c5c95bd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:41.242452 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4ebb4154-6a7f-4138-bdff-e446c5c95bd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:41.243425 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4ebb4154-6a7f-4138-bdff-e446c5c95bd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:41.244016 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4ebb4154-6a7f-4138-bdff-e446c5c95bd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:41.310419 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-4ebb4154-6a7f-4138-bdff-e446c5c95bd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:41.318675 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4ebb4154-6a7f-4138-bdff-e446c5c95bd5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495" status: 200 len: 1278 microversion: 2.1 time: 0.088948 Nov 23 07:46:41.319420 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 305/584] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:41 2021] GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495 => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:41.755386 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f1842c7b-b433-483d-b49e-1c353e96cf6d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:41.755901 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f1842c7b-b433-483d-b49e-1c353e96cf6d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:41.761728 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f1842c7b-b433-483d-b49e-1c353e96cf6d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:41.762181 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f1842c7b-b433-483d-b49e-1c353e96cf6d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:41.762958 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f1842c7b-b433-483d-b49e-1c353e96cf6d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:41.763385 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f1842c7b-b433-483d-b49e-1c353e96cf6d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:41.841658 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.objects.instance [None req-f1842c7b-b433-483d-b49e-1c353e96cf6d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lazy-loading 'services' on Instance uuid 28c2d383-cc82-4479-b0fe-d92e63ef538d {{(pid=122785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:46:41.913810 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f1842c7b-b433-483d-b49e-1c353e96cf6d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "DELETE /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/os-volume_attachments/b85172fa-e98d-4668-9f66-dcb4b0737d81" status: 202 len: 0 microversion: 2.1 time: 0.161823 Nov 23 07:46:41.914404 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 280/585] 10.222.0.48 () {58 vars in 1415 bytes} [Tue Nov 23 07:46:41 2021] DELETE /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/os-volume_attachments/b85172fa-e98d-4668-9f66-dcb4b0737d81 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:46:41.944366 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-71440640-4b41-4096-a229-381201e4836c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:41.945031 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-71440640-4b41-4096-a229-381201e4836c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: 6b9df126-b886-4cb5-88f0-20dc6e22dbe1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:41.951806 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-71440640-4b41-4096-a229-381201e4836c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:41.952257 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-71440640-4b41-4096-a229-381201e4836c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:41.953110 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-71440640-4b41-4096-a229-381201e4836c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:41.953526 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-71440640-4b41-4096-a229-381201e4836c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:41.968225 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-71440640-4b41-4096-a229-381201e4836c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] HTTP exception thrown: Instance 6b9df126-b886-4cb5-88f0-20dc6e22dbe1 could not be found. Nov 23 07:46:41.968973 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-71440640-4b41-4096-a229-381201e4836c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Returning 404 to user: Instance 6b9df126-b886-4cb5-88f0-20dc6e22dbe1 could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:46:41.969815 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-71440640-4b41-4096-a229-381201e4836c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1" status: 404 len: 111 microversion: 2.1 time: 0.029797 Nov 23 07:46:41.970502 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 306/586] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:41 2021] GET /compute/v2.1/servers/6b9df126-b886-4cb5-88f0-20dc6e22dbe1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:46:41.983082 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-8956a7b4-e258-48ae-a665-0721e570db45 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:41.983690 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-8956a7b4-e258-48ae-a665-0721e570db45 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:41.989675 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8956a7b4-e258-48ae-a665-0721e570db45 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:41.990161 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8956a7b4-e258-48ae-a665-0721e570db45 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:41.991062 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8956a7b4-e258-48ae-a665-0721e570db45 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:41.991667 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8956a7b4-e258-48ae-a665-0721e570db45 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:42.018121 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-8956a7b4-e258-48ae-a665-0721e570db45 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Going to try to terminate instance {{(pid=122785) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:46:42.102229 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-8956a7b4-e258-48ae-a665-0721e570db45 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 204 len: 0 microversion: 2.1 time: 0.122817 Nov 23 07:46:42.102918 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 281/587] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:46:41 2021] DELETE /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 07:46:42.110820 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-f3335715-b735-4653-8a00-3f8a48b803a5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:42.111413 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f3335715-b735-4653-8a00-3f8a48b803a5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:42.117724 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f3335715-b735-4653-8a00-3f8a48b803a5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:42.118217 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f3335715-b735-4653-8a00-3f8a48b803a5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:42.119003 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f3335715-b735-4653-8a00-3f8a48b803a5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:42.119433 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f3335715-b735-4653-8a00-3f8a48b803a5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:42.236685 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f23380d1-ee40-45f7-8af3-6f4637bb3359 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:42.237848 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f23380d1-ee40-45f7-8af3-6f4637bb3359 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:42.244520 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f23380d1-ee40-45f7-8af3-6f4637bb3359 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:42.245043 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f23380d1-ee40-45f7-8af3-6f4637bb3359 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:42.246113 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f23380d1-ee40-45f7-8af3-6f4637bb3359 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:42.246477 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f23380d1-ee40-45f7-8af3-6f4637bb3359 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:42.249862 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-f3335715-b735-4653-8a00-3f8a48b803a5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:42.257668 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-f3335715-b735-4653-8a00-3f8a48b803a5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1522 microversion: 2.1 time: 0.150503 Nov 23 07:46:42.258448 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 307/588] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:42 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:42.336640 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-934bf470-b173-467c-b8c5-9d30b10bc63d tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:42.337374 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-934bf470-b173-467c-b8c5-9d30b10bc63d tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 02f5ff24-8ac7-420f-b8ef-3b4d52919495] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:42.343866 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-934bf470-b173-467c-b8c5-9d30b10bc63d tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:42.344319 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-934bf470-b173-467c-b8c5-9d30b10bc63d tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:42.345112 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-934bf470-b173-467c-b8c5-9d30b10bc63d tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:42.345547 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-934bf470-b173-467c-b8c5-9d30b10bc63d tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:42.470907 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f23380d1-ee40-45f7-8af3-6f4637bb3359 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:42.483875 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f23380d1-ee40-45f7-8af3-6f4637bb3359 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:42.485534 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f23380d1-ee40-45f7-8af3-6f4637bb3359 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:42.486734 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f23380d1-ee40-45f7-8af3-6f4637bb3359 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1793 microversion: 2.20 time: 0.254081 Nov 23 07:46:42.487296 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 282/589] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:46:42 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1793 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:46:42.491487 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-934bf470-b173-467c-b8c5-9d30b10bc63d tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:42.499463 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-934bf470-b173-467c-b8c5-9d30b10bc63d tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495" status: 200 len: 1318 microversion: 2.1 time: 0.167538 Nov 23 07:46:42.500024 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 308/590] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:42 2021] GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:46:42.592273 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-91656838-5c15-409c-ad86-eb87d20e6d2c req-f93c9f4f-5709-430b-aae5-3df15684510f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f5ff24-8ac7-420f-b8ef-3b4d52919495", "tag": "25d4b466-b47f-4508-8609-a0825eaf3952"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:46:42.594008 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:46:42.594008 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:46:42.603047 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-91656838-5c15-409c-ad86-eb87d20e6d2c req-f93c9f4f-5709-430b-aae5-3df15684510f service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:42.603717 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-91656838-5c15-409c-ad86-eb87d20e6d2c req-f93c9f4f-5709-430b-aae5-3df15684510f service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:42.615371 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-91656838-5c15-409c-ad86-eb87d20e6d2c req-f93c9f4f-5709-430b-aae5-3df15684510f service nova] Creating event network-changed:25d4b466-b47f-4508-8609-a0825eaf3952 for instance 02f5ff24-8ac7-420f-b8ef-3b4d52919495 on hv-cinder-80403 Nov 23 07:46:42.621111 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-91656838-5c15-409c-ad86-eb87d20e6d2c req-f93c9f4f-5709-430b-aae5-3df15684510f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034248 Nov 23 07:46:42.621942 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 283/591] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:46:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:46:43.029859 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-93f2314c-c6bb-46cf-9360-927e3954827f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:46:43.036472 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-93f2314c-c6bb-46cf-9360-927e3954827f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:43.036923 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-93f2314c-c6bb-46cf-9360-927e3954827f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:43.060201 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-93f2314c-c6bb-46cf-9360-927e3954827f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Going to try to stop instance {{(pid=122786) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 23 07:46:43.106363 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-93f2314c-c6bb-46cf-9360-927e3954827f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 202 len: 0 microversion: 2.1 time: 0.079956 Nov 23 07:46:43.106974 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 309/592] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:46:43 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:46:43.115879 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-40f441e8-a8c5-4608-9a37-d8c73918a4d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:43.116581 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-40f441e8-a8c5-4608-9a37-d8c73918a4d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:43.123026 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40f441e8-a8c5-4608-9a37-d8c73918a4d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:43.123479 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40f441e8-a8c5-4608-9a37-d8c73918a4d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:43.124259 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40f441e8-a8c5-4608-9a37-d8c73918a4d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:43.124691 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-40f441e8-a8c5-4608-9a37-d8c73918a4d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:43.276947 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-937ebfa8-11f3-42f1-bec7-27646a61f580 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:43.277640 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-937ebfa8-11f3-42f1-bec7-27646a61f580 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:43.283683 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-937ebfa8-11f3-42f1-bec7-27646a61f580 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:43.284132 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-937ebfa8-11f3-42f1-bec7-27646a61f580 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:43.284903 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-937ebfa8-11f3-42f1-bec7-27646a61f580 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:43.285335 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-937ebfa8-11f3-42f1-bec7-27646a61f580 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:43.360004 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-40f441e8-a8c5-4608-9a37-d8c73918a4d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:43.367741 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-40f441e8-a8c5-4608-9a37-d8c73918a4d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1678 microversion: 2.1 time: 0.256304 Nov 23 07:46:43.368414 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 284/593] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:43 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1678 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:43.419334 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-937ebfa8-11f3-42f1-bec7-27646a61f580 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:43.426653 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-937ebfa8-11f3-42f1-bec7-27646a61f580 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1522 microversion: 2.1 time: 0.153827 Nov 23 07:46:43.427220 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 310/594] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:43 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:46:43.517217 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-13cf6a1a-790d-4b2c-a590-8ce3a5681aa5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:43.517856 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-13cf6a1a-790d-4b2c-a590-8ce3a5681aa5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 02f5ff24-8ac7-420f-b8ef-3b4d52919495] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:43.525133 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13cf6a1a-790d-4b2c-a590-8ce3a5681aa5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:43.525600 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13cf6a1a-790d-4b2c-a590-8ce3a5681aa5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:43.526455 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13cf6a1a-790d-4b2c-a590-8ce3a5681aa5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:43.526897 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13cf6a1a-790d-4b2c-a590-8ce3a5681aa5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:43.695774 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-13cf6a1a-790d-4b2c-a590-8ce3a5681aa5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:43.703115 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-13cf6a1a-790d-4b2c-a590-8ce3a5681aa5 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495" status: 200 len: 1318 microversion: 2.1 time: 0.189596 Nov 23 07:46:43.703695 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 285/595] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:43 2021] GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:44.385190 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-07c519a8-d2b5-46ec-b9c8-1266c60d48c5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:44.385773 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-07c519a8-d2b5-46ec-b9c8-1266c60d48c5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:44.392106 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-07c519a8-d2b5-46ec-b9c8-1266c60d48c5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:44.392555 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-07c519a8-d2b5-46ec-b9c8-1266c60d48c5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:44.393323 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-07c519a8-d2b5-46ec-b9c8-1266c60d48c5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:44.393777 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-07c519a8-d2b5-46ec-b9c8-1266c60d48c5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:44.442658 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-be51590c-2c95-43d3-893f-5f2bfbaa9cf7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:44.443371 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-be51590c-2c95-43d3-893f-5f2bfbaa9cf7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:44.449536 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-be51590c-2c95-43d3-893f-5f2bfbaa9cf7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:44.450016 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-be51590c-2c95-43d3-893f-5f2bfbaa9cf7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:44.450778 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-be51590c-2c95-43d3-893f-5f2bfbaa9cf7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:44.451206 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-be51590c-2c95-43d3-893f-5f2bfbaa9cf7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:44.521539 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-07c519a8-d2b5-46ec-b9c8-1266c60d48c5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:44.530750 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-07c519a8-d2b5-46ec-b9c8-1266c60d48c5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1678 microversion: 2.1 time: 0.149159 Nov 23 07:46:44.531336 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 311/596] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:44 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:44.582959 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-be51590c-2c95-43d3-893f-5f2bfbaa9cf7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:44.590691 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-be51590c-2c95-43d3-893f-5f2bfbaa9cf7 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1522 microversion: 2.1 time: 0.151654 Nov 23 07:46:44.591237 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 286/597] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:44 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:46:44.720132 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-7f6cbcb7-2bf4-4baa-b00e-195cf8ca30bf tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:44.720744 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-7f6cbcb7-2bf4-4baa-b00e-195cf8ca30bf tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 02f5ff24-8ac7-420f-b8ef-3b4d52919495] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:44.727217 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7f6cbcb7-2bf4-4baa-b00e-195cf8ca30bf tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:44.727696 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7f6cbcb7-2bf4-4baa-b00e-195cf8ca30bf tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:44.728462 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7f6cbcb7-2bf4-4baa-b00e-195cf8ca30bf tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:44.728895 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7f6cbcb7-2bf4-4baa-b00e-195cf8ca30bf tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:44.866572 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-7f6cbcb7-2bf4-4baa-b00e-195cf8ca30bf tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:44.873862 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-7f6cbcb7-2bf4-4baa-b00e-195cf8ca30bf tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495" status: 200 len: 1318 microversion: 2.1 time: 0.157376 Nov 23 07:46:44.874436 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 312/598] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:44 2021] GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:45.548939 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f9619265-9384-40d8-b08d-bfaa5b7370ee tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:45.549540 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f9619265-9384-40d8-b08d-bfaa5b7370ee tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:45.556107 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f9619265-9384-40d8-b08d-bfaa5b7370ee tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:45.556548 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f9619265-9384-40d8-b08d-bfaa5b7370ee tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:45.557324 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f9619265-9384-40d8-b08d-bfaa5b7370ee tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:45.557776 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f9619265-9384-40d8-b08d-bfaa5b7370ee tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:45.607477 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6dfffcc4-f61e-427b-bbd8-7d2c2c9fb22b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:45.608310 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6dfffcc4-f61e-427b-bbd8-7d2c2c9fb22b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:45.614528 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6dfffcc4-f61e-427b-bbd8-7d2c2c9fb22b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:45.614974 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6dfffcc4-f61e-427b-bbd8-7d2c2c9fb22b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:45.615781 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6dfffcc4-f61e-427b-bbd8-7d2c2c9fb22b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:45.616210 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6dfffcc4-f61e-427b-bbd8-7d2c2c9fb22b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:45.694471 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f9619265-9384-40d8-b08d-bfaa5b7370ee tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:45.702102 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f9619265-9384-40d8-b08d-bfaa5b7370ee tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1678 microversion: 2.1 time: 0.156762 Nov 23 07:46:45.702682 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 287/599] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:45 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:45.749436 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6dfffcc4-f61e-427b-bbd8-7d2c2c9fb22b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:45.757648 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6dfffcc4-f61e-427b-bbd8-7d2c2c9fb22b tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1522 microversion: 2.1 time: 0.153777 Nov 23 07:46:45.758254 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 313/600] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:45 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:46:45.890909 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-31c86228-059a-4a52-8361-8944ecccd96b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:45.891426 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-31c86228-059a-4a52-8361-8944ecccd96b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 02f5ff24-8ac7-420f-b8ef-3b4d52919495] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:45.897301 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-31c86228-059a-4a52-8361-8944ecccd96b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:45.897771 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-31c86228-059a-4a52-8361-8944ecccd96b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:45.898540 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-31c86228-059a-4a52-8361-8944ecccd96b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:45.898966 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-31c86228-059a-4a52-8361-8944ecccd96b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:46.033029 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-31c86228-059a-4a52-8361-8944ecccd96b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:46.040617 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-31c86228-059a-4a52-8361-8944ecccd96b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495" status: 200 len: 1318 microversion: 2.1 time: 0.153430 Nov 23 07:46:46.041196 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 288/601] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:45 2021] GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:46.719732 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-2afc7916-fc24-476c-8494-3dad8414224c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:46.720402 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-2afc7916-fc24-476c-8494-3dad8414224c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:46.726800 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2afc7916-fc24-476c-8494-3dad8414224c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:46.727252 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2afc7916-fc24-476c-8494-3dad8414224c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:46.728032 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2afc7916-fc24-476c-8494-3dad8414224c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:46.728470 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2afc7916-fc24-476c-8494-3dad8414224c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:46.774321 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-fe65ee17-b18b-455d-967c-21a0a61b620c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:46.774927 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-fe65ee17-b18b-455d-967c-21a0a61b620c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:46.781813 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fe65ee17-b18b-455d-967c-21a0a61b620c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:46.782381 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fe65ee17-b18b-455d-967c-21a0a61b620c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:46.783066 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fe65ee17-b18b-455d-967c-21a0a61b620c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:46.783504 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fe65ee17-b18b-455d-967c-21a0a61b620c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:46.878425 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2afc7916-fc24-476c-8494-3dad8414224c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:46.886738 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-2afc7916-fc24-476c-8494-3dad8414224c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1678 microversion: 2.1 time: 0.170639 Nov 23 07:46:46.888013 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 314/602] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:46 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:46.921077 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-fe65ee17-b18b-455d-967c-21a0a61b620c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:46.928965 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-fe65ee17-b18b-455d-967c-21a0a61b620c tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1522 microversion: 2.1 time: 0.158223 Nov 23 07:46:46.929807 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 289/603] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:46 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:46:47.057896 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-3bbcfe0f-e929-4682-aeb4-611dc9374ab9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:47.058418 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-3bbcfe0f-e929-4682-aeb4-611dc9374ab9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 02f5ff24-8ac7-420f-b8ef-3b4d52919495] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:47.064334 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3bbcfe0f-e929-4682-aeb4-611dc9374ab9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:47.064853 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3bbcfe0f-e929-4682-aeb4-611dc9374ab9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:47.065542 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3bbcfe0f-e929-4682-aeb4-611dc9374ab9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:47.065997 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3bbcfe0f-e929-4682-aeb4-611dc9374ab9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:47.193001 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-3bbcfe0f-e929-4682-aeb4-611dc9374ab9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:47.200218 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-3bbcfe0f-e929-4682-aeb4-611dc9374ab9 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495" status: 200 len: 1318 microversion: 2.1 time: 0.146098 Nov 23 07:46:47.200791 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 315/604] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:47 2021] GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:47.904799 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-bf34b5e6-db41-4b64-aec5-5a3adebb3ba0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:47.905399 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-bf34b5e6-db41-4b64-aec5-5a3adebb3ba0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:47.911469 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bf34b5e6-db41-4b64-aec5-5a3adebb3ba0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:47.911914 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bf34b5e6-db41-4b64-aec5-5a3adebb3ba0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:47.913212 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bf34b5e6-db41-4b64-aec5-5a3adebb3ba0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:47.913643 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bf34b5e6-db41-4b64-aec5-5a3adebb3ba0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:47.945230 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-245d13dd-8783-4a7f-829c-b584e1c66d1f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:47.945867 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-245d13dd-8783-4a7f-829c-b584e1c66d1f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:47.952973 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-245d13dd-8783-4a7f-829c-b584e1c66d1f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:47.953428 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-245d13dd-8783-4a7f-829c-b584e1c66d1f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:47.954255 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-245d13dd-8783-4a7f-829c-b584e1c66d1f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:47.954691 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-245d13dd-8783-4a7f-829c-b584e1c66d1f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:48.057111 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-bf34b5e6-db41-4b64-aec5-5a3adebb3ba0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:48.065204 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-bf34b5e6-db41-4b64-aec5-5a3adebb3ba0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1678 microversion: 2.1 time: 0.163983 Nov 23 07:46:48.065499 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 290/605] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:47 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:48.096148 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-245d13dd-8783-4a7f-829c-b584e1c66d1f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:48.104384 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-245d13dd-8783-4a7f-829c-b584e1c66d1f tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1522 microversion: 2.1 time: 0.162812 Nov 23 07:46:48.104949 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 316/606] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:47 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:46:48.216266 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-4e4b1d1d-65cd-49f5-b5b8-0e9eaac84b94 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:48.216870 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-4e4b1d1d-65cd-49f5-b5b8-0e9eaac84b94 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 02f5ff24-8ac7-420f-b8ef-3b4d52919495] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:48.223755 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4e4b1d1d-65cd-49f5-b5b8-0e9eaac84b94 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:48.224399 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4e4b1d1d-65cd-49f5-b5b8-0e9eaac84b94 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:48.225645 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4e4b1d1d-65cd-49f5-b5b8-0e9eaac84b94 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:48.226109 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4e4b1d1d-65cd-49f5-b5b8-0e9eaac84b94 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:48.363793 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-4e4b1d1d-65cd-49f5-b5b8-0e9eaac84b94 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:48.371128 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-4e4b1d1d-65cd-49f5-b5b8-0e9eaac84b94 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495" status: 200 len: 1318 microversion: 2.1 time: 0.158489 Nov 23 07:46:48.380403 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 291/607] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:48 2021] GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:48.477745 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-4440481a-4582-4c3a-8c90-262f6774a78e req-80dbff61-8d14-4c64-97ca-ab94aad647d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f5ff24-8ac7-420f-b8ef-3b4d52919495", "name": "network-vif-plugged", "status": "completed", "tag": "25d4b466-b47f-4508-8609-a0825eaf3952"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:46:48.479369 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:46:48.479369 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:46:48.487357 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-4440481a-4582-4c3a-8c90-262f6774a78e req-80dbff61-8d14-4c64-97ca-ab94aad647d4 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:48.487761 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-4440481a-4582-4c3a-8c90-262f6774a78e req-80dbff61-8d14-4c64-97ca-ab94aad647d4 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:48.499415 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-4440481a-4582-4c3a-8c90-262f6774a78e req-80dbff61-8d14-4c64-97ca-ab94aad647d4 service nova] Creating event network-vif-plugged:25d4b466-b47f-4508-8609-a0825eaf3952 for instance 02f5ff24-8ac7-420f-b8ef-3b4d52919495 on hv-cinder-80403 Nov 23 07:46:48.505069 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-4440481a-4582-4c3a-8c90-262f6774a78e req-80dbff61-8d14-4c64-97ca-ab94aad647d4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032109 Nov 23 07:46:48.505069 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 317/608] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:46:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:46:49.094125 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-1051b108-3011-4daf-b77c-fd57e15f284e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:49.094956 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-1051b108-3011-4daf-b77c-fd57e15f284e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:49.102683 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1051b108-3011-4daf-b77c-fd57e15f284e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:49.103203 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1051b108-3011-4daf-b77c-fd57e15f284e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:49.105006 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1051b108-3011-4daf-b77c-fd57e15f284e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:49.106474 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1051b108-3011-4daf-b77c-fd57e15f284e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:49.122175 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b9e39ec7-a19f-4add-8d9d-fb84d0f694a5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:49.122866 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-b9e39ec7-a19f-4add-8d9d-fb84d0f694a5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:49.131087 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b9e39ec7-a19f-4add-8d9d-fb84d0f694a5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:49.131697 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b9e39ec7-a19f-4add-8d9d-fb84d0f694a5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:49.132752 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b9e39ec7-a19f-4add-8d9d-fb84d0f694a5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:49.133288 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b9e39ec7-a19f-4add-8d9d-fb84d0f694a5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:49.200059 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b9e39ec7-a19f-4add-8d9d-fb84d0f694a5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9ebd9d66ea4c5caba89d7620d28611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47c8e5e9704a0abf5643f488f1b2be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:49.207496 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b9e39ec7-a19f-4add-8d9d-fb84d0f694a5 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 200 len: 1480 microversion: 2.1 time: 0.090129 Nov 23 07:46:49.208088 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 318/609] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:49 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 1480 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:49.212982 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-172ca06e-bae7-4f54-8bf3-9f669a7351ce req-cf2fdb84-3664-4632-aa1d-9b85b25a2efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5cba5f7-c9fd-4708-923c-deec6ab27cdd", "name": "network-vif-deleted", "tag": "98e7ca52-3570-4eee-8b5d-7db714fe981a"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:46:49.214521 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:46:49.214521 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:46:49.221655 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-172ca06e-bae7-4f54-8bf3-9f669a7351ce req-cf2fdb84-3664-4632-aa1d-9b85b25a2efa service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:49.222135 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-172ca06e-bae7-4f54-8bf3-9f669a7351ce req-cf2fdb84-3664-4632-aa1d-9b85b25a2efa service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:49.233745 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-172ca06e-bae7-4f54-8bf3-9f669a7351ce req-cf2fdb84-3664-4632-aa1d-9b85b25a2efa service nova] Creating event network-vif-deleted:98e7ca52-3570-4eee-8b5d-7db714fe981a for instance c5cba5f7-c9fd-4708-923c-deec6ab27cdd on hv-cinder-80403 Nov 23 07:46:49.238789 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-172ca06e-bae7-4f54-8bf3-9f669a7351ce req-cf2fdb84-3664-4632-aa1d-9b85b25a2efa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029536 Nov 23 07:46:49.239403 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 319/610] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:46:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:46:49.266976 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-1051b108-3011-4daf-b77c-fd57e15f284e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:49.275479 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-1051b108-3011-4daf-b77c-fd57e15f284e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1678 microversion: 2.1 time: 0.190143 Nov 23 07:46:49.276765 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 292/611] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:49 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1678 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:49.388496 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e6d0ac36-215f-45b5-88e9-7a6c8f1bcfe4 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:49.389189 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e6d0ac36-215f-45b5-88e9-7a6c8f1bcfe4 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 02f5ff24-8ac7-420f-b8ef-3b4d52919495] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:49.395360 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e6d0ac36-215f-45b5-88e9-7a6c8f1bcfe4 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:49.395809 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e6d0ac36-215f-45b5-88e9-7a6c8f1bcfe4 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:49.397199 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e6d0ac36-215f-45b5-88e9-7a6c8f1bcfe4 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:49.397634 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e6d0ac36-215f-45b5-88e9-7a6c8f1bcfe4 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:49.528256 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-e6d0ac36-215f-45b5-88e9-7a6c8f1bcfe4 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:49.535544 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e6d0ac36-215f-45b5-88e9-7a6c8f1bcfe4 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495" status: 200 len: 1318 microversion: 2.1 time: 0.151071 Nov 23 07:46:49.536092 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 320/612] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:49 2021] GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:50.225437 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-fe0492e0-bbb3-40c8-a438-c80700637a11 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:50.226086 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-fe0492e0-bbb3-40c8-a438-c80700637a11 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] [instance: c5cba5f7-c9fd-4708-923c-deec6ab27cdd] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:50.233368 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fe0492e0-bbb3-40c8-a438-c80700637a11 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:50.233846 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fe0492e0-bbb3-40c8-a438-c80700637a11 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:50.234635 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fe0492e0-bbb3-40c8-a438-c80700637a11 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:50.235066 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fe0492e0-bbb3-40c8-a438-c80700637a11 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:50.248847 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-fe0492e0-bbb3-40c8-a438-c80700637a11 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] HTTP exception thrown: Instance c5cba5f7-c9fd-4708-923c-deec6ab27cdd could not be found. Nov 23 07:46:50.249435 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-fe0492e0-bbb3-40c8-a438-c80700637a11 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] Returning 404 to user: Instance c5cba5f7-c9fd-4708-923c-deec6ab27cdd could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:46:50.250297 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-fe0492e0-bbb3-40c8-a438-c80700637a11 tempest-ServerRescueNegativeTestJSON-1966618952 tempest-ServerRescueNegativeTestJSON-1966618952-project] 10.222.0.48 "GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd" status: 404 len: 111 microversion: 2.1 time: 0.029046 Nov 23 07:46:50.250834 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 293/613] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:50 2021] GET /compute/v2.1/servers/c5cba5f7-c9fd-4708-923c-deec6ab27cdd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:46:50.294119 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-66a4f34f-31eb-488f-a687-306d0aac3a86 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:50.295381 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-66a4f34f-31eb-488f-a687-306d0aac3a86 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:50.301683 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-66a4f34f-31eb-488f-a687-306d0aac3a86 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:50.302147 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-66a4f34f-31eb-488f-a687-306d0aac3a86 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:50.303792 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-66a4f34f-31eb-488f-a687-306d0aac3a86 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:50.304527 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-66a4f34f-31eb-488f-a687-306d0aac3a86 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:50.446733 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-66a4f34f-31eb-488f-a687-306d0aac3a86 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:50.454268 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-66a4f34f-31eb-488f-a687-306d0aac3a86 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1678 microversion: 2.1 time: 0.163819 Nov 23 07:46:50.455054 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 321/614] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:50 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:50.553809 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5410f2de-175a-4d91-ad31-0c247fc51fdf tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:50.554669 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5410f2de-175a-4d91-ad31-0c247fc51fdf tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 02f5ff24-8ac7-420f-b8ef-3b4d52919495] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:50.561938 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5410f2de-175a-4d91-ad31-0c247fc51fdf tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:50.562853 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5410f2de-175a-4d91-ad31-0c247fc51fdf tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:50.563778 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5410f2de-175a-4d91-ad31-0c247fc51fdf tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:50.564321 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5410f2de-175a-4d91-ad31-0c247fc51fdf tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:50.810156 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5410f2de-175a-4d91-ad31-0c247fc51fdf tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:50.817930 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5410f2de-175a-4d91-ad31-0c247fc51fdf tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495" status: 200 len: 1506 microversion: 2.1 time: 0.267983 Nov 23 07:46:50.819878 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 294/615] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:50 2021] GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:50.838663 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-545503a3-3c6c-4dcc-b444-45c6626af7e8 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f887447f-b8b3-49aa-b2e6-6245ba33e478", "device": "/dev/sdb"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:46:50.839782 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-545503a3-3c6c-4dcc-b444-45c6626af7e8 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 02f5ff24-8ac7-420f-b8ef-3b4d52919495] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:50.846018 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-545503a3-3c6c-4dcc-b444-45c6626af7e8 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:50.846472 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-545503a3-3c6c-4dcc-b444-45c6626af7e8 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:50.847260 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-545503a3-3c6c-4dcc-b444-45c6626af7e8 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:50.847701 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-545503a3-3c6c-4dcc-b444-45c6626af7e8 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:51.106488 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-545503a3-3c6c-4dcc-b444-45c6626af7e8 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "POST /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271343 Nov 23 07:46:51.107388 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 322/616] 10.222.0.48 () {60 vars in 1322 bytes} [Tue Nov 23 07:46:50 2021] POST /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:46:51.471979 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-fcbf3bf9-f010-4007-948a-a24160d2d309 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:51.472678 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-fcbf3bf9-f010-4007-948a-a24160d2d309 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:51.480194 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fcbf3bf9-f010-4007-948a-a24160d2d309 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:51.480727 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fcbf3bf9-f010-4007-948a-a24160d2d309 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:51.481768 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fcbf3bf9-f010-4007-948a-a24160d2d309 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:51.482211 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-fcbf3bf9-f010-4007-948a-a24160d2d309 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:51.725158 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-fcbf3bf9-f010-4007-948a-a24160d2d309 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:51.733229 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-fcbf3bf9-f010-4007-948a-a24160d2d309 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1678 microversion: 2.1 time: 0.264822 Nov 23 07:46:51.733869 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 295/617] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:51 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1678 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:52.564656 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-dacf2963-bc58-49a0-afdf-140b0b41fe12 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:46:52.565791 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-dacf2963-bc58-49a0-afdf-140b0b41fe12 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:52.577195 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-dacf2963-bc58-49a0-afdf-140b0b41fe12 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:52.577641 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-dacf2963-bc58-49a0-afdf-140b0b41fe12 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:52.578660 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-dacf2963-bc58-49a0-afdf-140b0b41fe12 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:52.579254 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-dacf2963-bc58-49a0-afdf-140b0b41fe12 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:52.657750 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-dacf2963-bc58-49a0-afdf-140b0b41fe12 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "POST /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/action" status: 202 len: 0 microversion: 2.1 time: 0.097433 Nov 23 07:46:52.661688 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 323/618] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:46:52 2021] POST /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:46:52.666986 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-e0460e3c-ddcb-4d4e-9caa-80679f305727 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:52.667601 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-e0460e3c-ddcb-4d4e-9caa-80679f305727 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:52.676005 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e0460e3c-ddcb-4d4e-9caa-80679f305727 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:52.676369 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e0460e3c-ddcb-4d4e-9caa-80679f305727 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:52.677146 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e0460e3c-ddcb-4d4e-9caa-80679f305727 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:52.677584 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e0460e3c-ddcb-4d4e-9caa-80679f305727 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:52.751574 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-0b8a869d-b167-419f-9453-85893f84dc22 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:52.752191 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-0b8a869d-b167-419f-9453-85893f84dc22 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:52.759773 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0b8a869d-b167-419f-9453-85893f84dc22 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:52.760227 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0b8a869d-b167-419f-9453-85893f84dc22 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:52.761014 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0b8a869d-b167-419f-9453-85893f84dc22 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:52.761449 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0b8a869d-b167-419f-9453-85893f84dc22 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:52.910445 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-0b8a869d-b167-419f-9453-85893f84dc22 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:52.918529 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-0b8a869d-b167-419f-9453-85893f84dc22 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1678 microversion: 2.1 time: 0.171052 Nov 23 07:46:52.923985 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 324/619] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:52 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:46:53.214781 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-e0460e3c-ddcb-4d4e-9caa-80679f305727 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:53.224196 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-e0460e3c-ddcb-4d4e-9caa-80679f305727 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1750 microversion: 2.1 time: 0.560707 Nov 23 07:46:53.225505 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 296/620] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:52 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1750 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:53.936318 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-aee555d0-a44d-4826-b73d-090b2aec82e9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:53.936871 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-aee555d0-a44d-4826-b73d-090b2aec82e9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:53.944326 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aee555d0-a44d-4826-b73d-090b2aec82e9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:53.944326 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aee555d0-a44d-4826-b73d-090b2aec82e9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:53.944809 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aee555d0-a44d-4826-b73d-090b2aec82e9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:53.945241 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aee555d0-a44d-4826-b73d-090b2aec82e9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:54.087339 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-aee555d0-a44d-4826-b73d-090b2aec82e9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:54.094584 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-aee555d0-a44d-4826-b73d-090b2aec82e9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1655 microversion: 2.1 time: 0.161919 Nov 23 07:46:54.095093 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 325/621] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:53 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1655 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:46:54.112082 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-eded0504-521d-4dc6-8229-db2b4f9078cc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:46:54.118979 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-eded0504-521d-4dc6-8229-db2b4f9078cc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:54.119422 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-eded0504-521d-4dc6-8229-db2b4f9078cc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:54.179540 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-eded0504-521d-4dc6-8229-db2b4f9078cc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Going to try to start instance {{(pid=122785) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 23 07:46:54.235355 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-eded0504-521d-4dc6-8229-db2b4f9078cc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action" status: 202 len: 0 microversion: 2.1 time: 0.126673 Nov 23 07:46:54.238775 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 297/622] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:46:54 2021] POST /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:46:54.248629 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-18aab369-b62a-4e66-a80c-4e51732a556b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:54.249511 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-18aab369-b62a-4e66-a80c-4e51732a556b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:54.258119 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-18aab369-b62a-4e66-a80c-4e51732a556b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:54.258825 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-18aab369-b62a-4e66-a80c-4e51732a556b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:54.259847 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-18aab369-b62a-4e66-a80c-4e51732a556b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:54.260433 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-18aab369-b62a-4e66-a80c-4e51732a556b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:54.262041 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-36e9d8b3-e863-454a-a41e-84a06066a27a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:54.262756 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-36e9d8b3-e863-454a-a41e-84a06066a27a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:54.268988 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-36e9d8b3-e863-454a-a41e-84a06066a27a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:54.269896 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-36e9d8b3-e863-454a-a41e-84a06066a27a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:54.270846 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-36e9d8b3-e863-454a-a41e-84a06066a27a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:54.271477 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-36e9d8b3-e863-454a-a41e-84a06066a27a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:54.640335 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-36e9d8b3-e863-454a-a41e-84a06066a27a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:54.648295 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-36e9d8b3-e863-454a-a41e-84a06066a27a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1664 microversion: 2.1 time: 0.400711 Nov 23 07:46:54.649030 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 298/623] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:54 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1664 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:54.682965 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-18aab369-b62a-4e66-a80c-4e51732a556b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:54.690894 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-18aab369-b62a-4e66-a80c-4e51732a556b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1755 microversion: 2.1 time: 0.447326 Nov 23 07:46:54.691471 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 326/624] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:54 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1755 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:46:55.644825 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-acd721e5-796b-4783-9f04-8dbb46777832 tempest-VolumesGetTestJSON-1668165523 tempest-VolumesGetTestJSON-1668165523-project] Action: 'create', calling method: .version_select at 0x7f051406ff70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1547679644", "metadata": {"Type": "work"}}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:46:55.670262 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-200771da-3280-4c8b-a242-ea87a5a9a802 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:55.672342 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-200771da-3280-4c8b-a242-ea87a5a9a802 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:55.683611 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-200771da-3280-4c8b-a242-ea87a5a9a802 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:55.684659 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-200771da-3280-4c8b-a242-ea87a5a9a802 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:55.685835 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-200771da-3280-4c8b-a242-ea87a5a9a802 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:55.686534 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-200771da-3280-4c8b-a242-ea87a5a9a802 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:55.857571 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-200771da-3280-4c8b-a242-ea87a5a9a802 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:55.865715 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-200771da-3280-4c8b-a242-ea87a5a9a802 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1668 microversion: 2.1 time: 0.203419 Nov 23 07:46:55.866400 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 327/625] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:55 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1668 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:55.870655 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-34e57c2f-24ec-4c6c-ba80-c381b775be12 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:55.871349 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-34e57c2f-24ec-4c6c-ba80-c381b775be12 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:55.878180 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-34e57c2f-24ec-4c6c-ba80-c381b775be12 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:55.878911 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-34e57c2f-24ec-4c6c-ba80-c381b775be12 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:55.879717 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-34e57c2f-24ec-4c6c-ba80-c381b775be12 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:55.880296 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-34e57c2f-24ec-4c6c-ba80-c381b775be12 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:56.046897 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-acd721e5-796b-4783-9f04-8dbb46777832 tempest-VolumesGetTestJSON-1668165523 tempest-VolumesGetTestJSON-1668165523-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.548970 Nov 23 07:46:56.054435 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 299/626] 10.222.0.48 () {60 vars in 1155 bytes} [Tue Nov 23 07:46:55 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 551 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 23 07:46:56.065989 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5eecfc23-3156-4835-a4d2-e77b5171dde6 tempest-VolumesGetTestJSON-1668165523 tempest-VolumesGetTestJSON-1668165523-project] Calling method '.version_select at 0x7f05141db790>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:56.067858 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-34e57c2f-24ec-4c6c-ba80-c381b775be12 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:56.083513 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-34e57c2f-24ec-4c6c-ba80-c381b775be12 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1755 microversion: 2.1 time: 0.215764 Nov 23 07:46:56.085079 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 328/627] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:55 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1755 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:56.128453 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5eecfc23-3156-4835-a4d2-e77b5171dde6 tempest-VolumesGetTestJSON-1668165523 tempest-VolumesGetTestJSON-1668165523-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b22ebb4c-f9b4-4681-b66c-8e5eb61db77e" status: 200 len: 353 microversion: 2.1 time: 0.072047 Nov 23 07:46:56.129632 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 300/628] 10.222.0.48 () {58 vars in 1244 bytes} [Tue Nov 23 07:46:56 2021] GET /compute/v2.1/os-volumes/b22ebb4c-f9b4-4681-b66c-8e5eb61db77e => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:46:57.103383 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1ac07d08-172c-4fa4-a8cd-9817b70d8d69 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:57.103986 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1ac07d08-172c-4fa4-a8cd-9817b70d8d69 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:57.110383 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1ac07d08-172c-4fa4-a8cd-9817b70d8d69 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:57.110841 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1ac07d08-172c-4fa4-a8cd-9817b70d8d69 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:57.111612 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1ac07d08-172c-4fa4-a8cd-9817b70d8d69 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:57.112052 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1ac07d08-172c-4fa4-a8cd-9817b70d8d69 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:57.143162 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-2f5e7bd2-ec74-4dcb-99b1-a00389ccdb30 tempest-VolumesGetTestJSON-1668165523 tempest-VolumesGetTestJSON-1668165523-project] Calling method '.version_select at 0x7f051433c550>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:57.194595 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-2f5e7bd2-ec74-4dcb-99b1-a00389ccdb30 tempest-VolumesGetTestJSON-1668165523 tempest-VolumesGetTestJSON-1668165523-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b22ebb4c-f9b4-4681-b66c-8e5eb61db77e" status: 200 len: 354 microversion: 2.1 time: 0.056195 Nov 23 07:46:57.195817 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 301/629] 10.222.0.48 () {58 vars in 1244 bytes} [Tue Nov 23 07:46:57 2021] GET /compute/v2.1/os-volumes/b22ebb4c-f9b4-4681-b66c-8e5eb61db77e => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:46:57.211232 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-27834eb3-1e02-48b5-8898-37a3c493a879 tempest-VolumesGetTestJSON-1668165523 tempest-VolumesGetTestJSON-1668165523-project] Calling method '.version_select at 0x7f0514236310>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:57.259601 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-27834eb3-1e02-48b5-8898-37a3c493a879 tempest-VolumesGetTestJSON-1668165523 tempest-VolumesGetTestJSON-1668165523-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b22ebb4c-f9b4-4681-b66c-8e5eb61db77e" status: 200 len: 354 microversion: 2.1 time: 0.052709 Nov 23 07:46:57.260181 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 302/630] 10.222.0.48 () {58 vars in 1244 bytes} [Tue Nov 23 07:46:57 2021] GET /compute/v2.1/os-volumes/b22ebb4c-f9b4-4681-b66c-8e5eb61db77e => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:46:57.284607 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ae53381a-3bda-414c-afbe-a03cc9a62d66 tempest-VolumesGetTestJSON-1668165523 tempest-VolumesGetTestJSON-1668165523-project] Calling method '.version_select at 0x7f05141e9d30>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:57.287848 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1ac07d08-172c-4fa4-a8cd-9817b70d8d69 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:57.296083 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1ac07d08-172c-4fa4-a8cd-9817b70d8d69 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1755 microversion: 2.1 time: 0.196394 Nov 23 07:46:57.296868 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 329/631] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:57 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1755 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:46:57.350481 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ae53381a-3bda-414c-afbe-a03cc9a62d66 tempest-VolumesGetTestJSON-1668165523 tempest-VolumesGetTestJSON-1668165523-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/b22ebb4c-f9b4-4681-b66c-8e5eb61db77e" status: 202 len: 0 microversion: 2.1 time: 0.069229 Nov 23 07:46:57.351830 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 303/632] 10.222.0.48 () {58 vars in 1247 bytes} [Tue Nov 23 07:46:57 2021] DELETE /compute/v2.1/os-volumes/b22ebb4c-f9b4-4681-b66c-8e5eb61db77e => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:46:57.360622 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-33123568-7126-499f-8a53-72342c01c998 tempest-VolumesGetTestJSON-1668165523 tempest-VolumesGetTestJSON-1668165523-project] Calling method '.version_select at 0x7f0514771160>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:57.413530 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-33123568-7126-499f-8a53-72342c01c998 tempest-VolumesGetTestJSON-1668165523 tempest-VolumesGetTestJSON-1668165523-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b22ebb4c-f9b4-4681-b66c-8e5eb61db77e" status: 200 len: 353 microversion: 2.1 time: 0.056621 Nov 23 07:46:57.414338 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 330/633] 10.222.0.48 () {58 vars in 1244 bytes} [Tue Nov 23 07:46:57 2021] GET /compute/v2.1/os-volumes/b22ebb4c-f9b4-4681-b66c-8e5eb61db77e => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:46:58.314519 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-4c4831cf-9f80-4f69-907e-bd1beb5556dc tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:58.315145 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-4c4831cf-9f80-4f69-907e-bd1beb5556dc tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:58.324147 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4c4831cf-9f80-4f69-907e-bd1beb5556dc tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:58.324596 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4c4831cf-9f80-4f69-907e-bd1beb5556dc tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:58.325382 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4c4831cf-9f80-4f69-907e-bd1beb5556dc tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:58.325853 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4c4831cf-9f80-4f69-907e-bd1beb5556dc tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:58.427224 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b3cfe733-5ef9-4319-8bf6-44b2f45f76b1 tempest-VolumesGetTestJSON-1668165523 tempest-VolumesGetTestJSON-1668165523-project] Calling method '.version_select at 0x7f0514847a60>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:58.458312 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-b3cfe733-5ef9-4319-8bf6-44b2f45f76b1 tempest-VolumesGetTestJSON-1668165523 tempest-VolumesGetTestJSON-1668165523-project] HTTP exception thrown: Volume b22ebb4c-f9b4-4681-b66c-8e5eb61db77e could not be found. Nov 23 07:46:58.460056 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b3cfe733-5ef9-4319-8bf6-44b2f45f76b1 tempest-VolumesGetTestJSON-1668165523 tempest-VolumesGetTestJSON-1668165523-project] Returning 404 to user: Volume b22ebb4c-f9b4-4681-b66c-8e5eb61db77e could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:46:58.461581 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b3cfe733-5ef9-4319-8bf6-44b2f45f76b1 tempest-VolumesGetTestJSON-1668165523 tempest-VolumesGetTestJSON-1668165523-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b22ebb4c-f9b4-4681-b66c-8e5eb61db77e" status: 404 len: 109 microversion: 2.1 time: 0.038815 Nov 23 07:46:58.462626 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 331/634] 10.222.0.48 () {58 vars in 1244 bytes} [Tue Nov 23 07:46:58 2021] GET /compute/v2.1/os-volumes/b22ebb4c-f9b4-4681-b66c-8e5eb61db77e => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 07:46:58.484293 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-4c4831cf-9f80-4f69-907e-bd1beb5556dc tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:58.493423 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-4c4831cf-9f80-4f69-907e-bd1beb5556dc tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1755 microversion: 2.1 time: 0.182994 Nov 23 07:46:58.494059 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 304/635] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:58 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:46:59.512667 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-90f8a483-e21e-4448-a3f9-56a1259466d4 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:46:59.513364 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-90f8a483-e21e-4448-a3f9-56a1259466d4 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:46:59.519582 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-90f8a483-e21e-4448-a3f9-56a1259466d4 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:59.520043 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-90f8a483-e21e-4448-a3f9-56a1259466d4 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:59.520842 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-90f8a483-e21e-4448-a3f9-56a1259466d4 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:46:59.521434 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-90f8a483-e21e-4448-a3f9-56a1259466d4 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:46:59.675411 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-90f8a483-e21e-4448-a3f9-56a1259466d4 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:46:59.687601 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-90f8a483-e21e-4448-a3f9-56a1259466d4 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1755 microversion: 2.1 time: 0.178787 Nov 23 07:46:59.688668 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 332/636] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:46:59 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:47:00.707415 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-0e9d9a3b-2a16-46e0-8d60-80237aa9cca5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:00.708135 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-0e9d9a3b-2a16-46e0-8d60-80237aa9cca5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:00.715479 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0e9d9a3b-2a16-46e0-8d60-80237aa9cca5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:00.715991 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0e9d9a3b-2a16-46e0-8d60-80237aa9cca5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:00.716775 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0e9d9a3b-2a16-46e0-8d60-80237aa9cca5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:00.717205 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0e9d9a3b-2a16-46e0-8d60-80237aa9cca5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:00.880352 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0e9d9a3b-2a16-46e0-8d60-80237aa9cca5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:00.888845 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-0e9d9a3b-2a16-46e0-8d60-80237aa9cca5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1755 microversion: 2.1 time: 0.185040 Nov 23 07:47:00.889438 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 305/637] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:47:00 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:47:01.906620 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ced96784-c276-4238-91fa-b836814dea14 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:01.907199 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ced96784-c276-4238-91fa-b836814dea14 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:01.913872 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ced96784-c276-4238-91fa-b836814dea14 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:01.914571 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ced96784-c276-4238-91fa-b836814dea14 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:01.915378 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ced96784-c276-4238-91fa-b836814dea14 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:01.915808 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ced96784-c276-4238-91fa-b836814dea14 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:02.109555 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ced96784-c276-4238-91fa-b836814dea14 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:02.118689 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ced96784-c276-4238-91fa-b836814dea14 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1755 microversion: 2.1 time: 0.215758 Nov 23 07:47:02.119371 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 333/638] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:47:01 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1755 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:47:03.136128 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-4ee63cb8-cc2d-46cf-9dcd-1afa68d2a47c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:03.136733 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-4ee63cb8-cc2d-46cf-9dcd-1afa68d2a47c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:03.143207 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4ee63cb8-cc2d-46cf-9dcd-1afa68d2a47c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:03.143700 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4ee63cb8-cc2d-46cf-9dcd-1afa68d2a47c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:03.144485 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4ee63cb8-cc2d-46cf-9dcd-1afa68d2a47c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:03.144943 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4ee63cb8-cc2d-46cf-9dcd-1afa68d2a47c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:03.298448 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-4ee63cb8-cc2d-46cf-9dcd-1afa68d2a47c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:03.306339 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-4ee63cb8-cc2d-46cf-9dcd-1afa68d2a47c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1755 microversion: 2.1 time: 0.173758 Nov 23 07:47:03.307234 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 306/639] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:47:03 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:47:04.323770 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b721a951-cd0e-4678-a39f-e50185a515eb tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:04.324316 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-b721a951-cd0e-4678-a39f-e50185a515eb tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:04.330584 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b721a951-cd0e-4678-a39f-e50185a515eb tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:04.331038 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b721a951-cd0e-4678-a39f-e50185a515eb tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:04.331823 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b721a951-cd0e-4678-a39f-e50185a515eb tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:04.332257 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b721a951-cd0e-4678-a39f-e50185a515eb tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:04.476336 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b721a951-cd0e-4678-a39f-e50185a515eb tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:04.484264 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b721a951-cd0e-4678-a39f-e50185a515eb tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1755 microversion: 2.1 time: 0.164695 Nov 23 07:47:04.484835 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 334/640] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:47:04 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:47:05.502284 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-6e55df1c-a41c-4ccc-940c-d4baa27844e8 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:05.502887 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-6e55df1c-a41c-4ccc-940c-d4baa27844e8 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:05.509794 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6e55df1c-a41c-4ccc-940c-d4baa27844e8 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:05.510237 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6e55df1c-a41c-4ccc-940c-d4baa27844e8 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:05.511000 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6e55df1c-a41c-4ccc-940c-d4baa27844e8 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:05.511427 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6e55df1c-a41c-4ccc-940c-d4baa27844e8 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:05.654603 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-6e55df1c-a41c-4ccc-940c-d4baa27844e8 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:05.662742 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-6e55df1c-a41c-4ccc-940c-d4baa27844e8 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1755 microversion: 2.1 time: 0.164111 Nov 23 07:47:05.663305 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 307/641] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:47:05 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:47:06.679681 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1677d921-9311-4d49-98a7-305d69bd9b8c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:06.680396 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1677d921-9311-4d49-98a7-305d69bd9b8c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:06.686844 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1677d921-9311-4d49-98a7-305d69bd9b8c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:06.687392 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1677d921-9311-4d49-98a7-305d69bd9b8c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:06.688280 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1677d921-9311-4d49-98a7-305d69bd9b8c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:06.688789 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1677d921-9311-4d49-98a7-305d69bd9b8c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:06.859052 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1677d921-9311-4d49-98a7-305d69bd9b8c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:06.866733 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1677d921-9311-4d49-98a7-305d69bd9b8c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1755 microversion: 2.1 time: 0.190759 Nov 23 07:47:06.867300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 335/642] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:47:06 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:47:07.883740 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-2682dc89-8bd6-4308-bea0-31e6ce7de2b7 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:07.884345 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-2682dc89-8bd6-4308-bea0-31e6ce7de2b7 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:07.890856 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2682dc89-8bd6-4308-bea0-31e6ce7de2b7 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:07.891426 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2682dc89-8bd6-4308-bea0-31e6ce7de2b7 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:07.892326 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2682dc89-8bd6-4308-bea0-31e6ce7de2b7 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:07.892773 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2682dc89-8bd6-4308-bea0-31e6ce7de2b7 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:08.038989 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-2682dc89-8bd6-4308-bea0-31e6ce7de2b7 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:08.047091 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-2682dc89-8bd6-4308-bea0-31e6ce7de2b7 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1755 microversion: 2.1 time: 0.167135 Nov 23 07:47:08.047670 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 308/643] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:47:07 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:47:09.064934 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-2dd946d1-40e4-48ae-b67f-ae00cb543102 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:09.065543 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-2dd946d1-40e4-48ae-b67f-ae00cb543102 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:09.073175 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2dd946d1-40e4-48ae-b67f-ae00cb543102 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:09.074033 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2dd946d1-40e4-48ae-b67f-ae00cb543102 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:09.075462 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2dd946d1-40e4-48ae-b67f-ae00cb543102 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:09.076355 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2dd946d1-40e4-48ae-b67f-ae00cb543102 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:09.246765 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2dd946d1-40e4-48ae-b67f-ae00cb543102 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:09.258884 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-2dd946d1-40e4-48ae-b67f-ae00cb543102 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1755 microversion: 2.1 time: 0.198309 Nov 23 07:47:09.260089 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 336/644] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:47:09 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:47:09.421059 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f7d41255-4883-4ad0-81f8-411d886bf825 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:09.422202 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f7d41255-4883-4ad0-81f8-411d886bf825 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 02f5ff24-8ac7-420f-b8ef-3b4d52919495] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:09.429024 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f7d41255-4883-4ad0-81f8-411d886bf825 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:09.429759 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f7d41255-4883-4ad0-81f8-411d886bf825 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:09.430554 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f7d41255-4883-4ad0-81f8-411d886bf825 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:09.431144 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f7d41255-4883-4ad0-81f8-411d886bf825 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:09.526117 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.objects.instance [None req-f7d41255-4883-4ad0-81f8-411d886bf825 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lazy-loading 'services' on Instance uuid 02f5ff24-8ac7-420f-b8ef-3b4d52919495 {{(pid=122785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:47:09.608209 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f7d41255-4883-4ad0-81f8-411d886bf825 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "DELETE /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495/os-volume_attachments/f887447f-b8b3-49aa-b2e6-6245ba33e478" status: 202 len: 0 microversion: 2.1 time: 0.191261 Nov 23 07:47:09.608808 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 309/645] 10.222.0.48 () {58 vars in 1415 bytes} [Tue Nov 23 07:47:09 2021] DELETE /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495/os-volume_attachments/f887447f-b8b3-49aa-b2e6-6245ba33e478 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:47:10.278231 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-97beb20d-fbd6-4707-a551-459430e9a6f5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:10.279417 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-97beb20d-fbd6-4707-a551-459430e9a6f5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:10.286325 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-97beb20d-fbd6-4707-a551-459430e9a6f5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:10.287227 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-97beb20d-fbd6-4707-a551-459430e9a6f5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:10.288684 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-97beb20d-fbd6-4707-a551-459430e9a6f5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:10.289106 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-97beb20d-fbd6-4707-a551-459430e9a6f5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:10.448030 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-97beb20d-fbd6-4707-a551-459430e9a6f5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:10.456479 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-97beb20d-fbd6-4707-a551-459430e9a6f5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1755 microversion: 2.1 time: 0.182111 Nov 23 07:47:10.457164 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 337/646] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:47:10 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:47:10.721492 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-e8a51b22-da3c-478a-b0c0-5385bee635db tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:10.722105 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-e8a51b22-da3c-478a-b0c0-5385bee635db tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 02f5ff24-8ac7-420f-b8ef-3b4d52919495] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:10.730127 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e8a51b22-da3c-478a-b0c0-5385bee635db tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:10.730661 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e8a51b22-da3c-478a-b0c0-5385bee635db tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:10.731523 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e8a51b22-da3c-478a-b0c0-5385bee635db tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:10.731960 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e8a51b22-da3c-478a-b0c0-5385bee635db tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:10.757989 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-e8a51b22-da3c-478a-b0c0-5385bee635db tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 02f5ff24-8ac7-420f-b8ef-3b4d52919495] Going to try to terminate instance {{(pid=122785) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:47:10.841411 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-e8a51b22-da3c-478a-b0c0-5385bee635db tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "DELETE /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495" status: 204 len: 0 microversion: 2.1 time: 0.124150 Nov 23 07:47:10.842068 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 310/647] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:47:10 2021] DELETE /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 07:47:10.851484 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-832f9bf7-6b58-4af7-9318-6e02bcc7800b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:10.852219 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-832f9bf7-6b58-4af7-9318-6e02bcc7800b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 02f5ff24-8ac7-420f-b8ef-3b4d52919495] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:10.858894 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-832f9bf7-6b58-4af7-9318-6e02bcc7800b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:10.859344 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-832f9bf7-6b58-4af7-9318-6e02bcc7800b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:10.860176 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-832f9bf7-6b58-4af7-9318-6e02bcc7800b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:10.860608 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-832f9bf7-6b58-4af7-9318-6e02bcc7800b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:11.018200 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-832f9bf7-6b58-4af7-9318-6e02bcc7800b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:11.028087 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-832f9bf7-6b58-4af7-9318-6e02bcc7800b tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495" status: 200 len: 1512 microversion: 2.1 time: 0.181486 Nov 23 07:47:11.028674 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 338/648] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:47:10 2021] GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495 => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:47:11.475293 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-01ec9389-1622-4ba6-a4f6-9021acf3661b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:11.475914 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-01ec9389-1622-4ba6-a4f6-9021acf3661b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:11.481814 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-01ec9389-1622-4ba6-a4f6-9021acf3661b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:11.482306 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-01ec9389-1622-4ba6-a4f6-9021acf3661b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:11.483117 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-01ec9389-1622-4ba6-a4f6-9021acf3661b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:11.483538 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-01ec9389-1622-4ba6-a4f6-9021acf3661b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:11.636448 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-01ec9389-1622-4ba6-a4f6-9021acf3661b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:11.644351 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-01ec9389-1622-4ba6-a4f6-9021acf3661b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1755 microversion: 2.1 time: 0.173181 Nov 23 07:47:11.644942 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 311/649] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:47:11 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:47:12.046842 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4ab8287a-547d-410b-83c5-4e410f2753bb tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:12.047566 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4ab8287a-547d-410b-83c5-4e410f2753bb tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 02f5ff24-8ac7-420f-b8ef-3b4d52919495] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:12.054774 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4ab8287a-547d-410b-83c5-4e410f2753bb tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:12.055225 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4ab8287a-547d-410b-83c5-4e410f2753bb tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:12.055997 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4ab8287a-547d-410b-83c5-4e410f2753bb tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:12.056423 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4ab8287a-547d-410b-83c5-4e410f2753bb tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:12.191201 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-4ab8287a-547d-410b-83c5-4e410f2753bb tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:12.198671 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4ab8287a-547d-410b-83c5-4e410f2753bb tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495" status: 200 len: 1512 microversion: 2.1 time: 0.155443 Nov 23 07:47:12.199242 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 339/650] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:47:12 2021] GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:47:12.661351 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-e30dbe7e-ef5d-4ed6-9565-bd4febc0bf8f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:12.662275 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-e30dbe7e-ef5d-4ed6-9565-bd4febc0bf8f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:12.668460 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e30dbe7e-ef5d-4ed6-9565-bd4febc0bf8f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:12.668897 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e30dbe7e-ef5d-4ed6-9565-bd4febc0bf8f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:12.669656 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e30dbe7e-ef5d-4ed6-9565-bd4febc0bf8f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:12.670104 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e30dbe7e-ef5d-4ed6-9565-bd4febc0bf8f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:12.847401 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-e30dbe7e-ef5d-4ed6-9565-bd4febc0bf8f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:12.855336 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-e30dbe7e-ef5d-4ed6-9565-bd4febc0bf8f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1755 microversion: 2.1 time: 0.197561 Nov 23 07:47:12.855915 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 312/651] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:47:12 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1755 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:47:13.224587 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ae71ca21-0648-4af9-8f04-655e17484430 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:13.225221 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ae71ca21-0648-4af9-8f04-655e17484430 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 02f5ff24-8ac7-420f-b8ef-3b4d52919495] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:13.232714 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ae71ca21-0648-4af9-8f04-655e17484430 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:13.233519 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ae71ca21-0648-4af9-8f04-655e17484430 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:13.234387 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ae71ca21-0648-4af9-8f04-655e17484430 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:13.234832 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ae71ca21-0648-4af9-8f04-655e17484430 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:13.271301 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-f3a0cecd-03cd-4b3d-a22c-a75379d49100 req-95e7f319-55b5-496a-aa8c-368ee93c20f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f5ff24-8ac7-420f-b8ef-3b4d52919495", "name": "network-vif-deleted", "tag": "25d4b466-b47f-4508-8609-a0825eaf3952"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:47:13.273891 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:47:13.273891 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:47:13.291970 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-f3a0cecd-03cd-4b3d-a22c-a75379d49100 req-95e7f319-55b5-496a-aa8c-368ee93c20f7 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:13.292424 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-f3a0cecd-03cd-4b3d-a22c-a75379d49100 req-95e7f319-55b5-496a-aa8c-368ee93c20f7 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:13.308993 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-f3a0cecd-03cd-4b3d-a22c-a75379d49100 req-95e7f319-55b5-496a-aa8c-368ee93c20f7 service nova] Creating event network-vif-deleted:25d4b466-b47f-4508-8609-a0825eaf3952 for instance 02f5ff24-8ac7-420f-b8ef-3b4d52919495 on hv-cinder-80403 Nov 23 07:47:13.315813 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-f3a0cecd-03cd-4b3d-a22c-a75379d49100 req-95e7f319-55b5-496a-aa8c-368ee93c20f7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048195 Nov 23 07:47:13.316741 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 313/652] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:47:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:47:13.334876 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ae71ca21-0648-4af9-8f04-655e17484430 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82a3ef8b5604e208e028a5b0386c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230efaa941f948e5b6c183a252310eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:13.357582 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ae71ca21-0648-4af9-8f04-655e17484430 tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495" status: 200 len: 1470 microversion: 2.1 time: 0.140889 Nov 23 07:47:13.357582 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 340/653] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:47:13 2021] GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495 => generated 1470 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:47:13.873114 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d359c28b-fa32-4465-ba47-f58c59062fb3 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:13.873832 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d359c28b-fa32-4465-ba47-f58c59062fb3 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:13.880390 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d359c28b-fa32-4465-ba47-f58c59062fb3 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:13.880826 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d359c28b-fa32-4465-ba47-f58c59062fb3 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:13.881609 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d359c28b-fa32-4465-ba47-f58c59062fb3 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:13.882073 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d359c28b-fa32-4465-ba47-f58c59062fb3 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:14.028116 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d359c28b-fa32-4465-ba47-f58c59062fb3 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:14.036026 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d359c28b-fa32-4465-ba47-f58c59062fb3 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1755 microversion: 2.1 time: 0.166916 Nov 23 07:47:14.037395 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 314/654] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:47:13 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:47:14.370174 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a6381378-5b5a-4ec1-a8ad-7e913f49459a tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:14.370695 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a6381378-5b5a-4ec1-a8ad-7e913f49459a tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] [instance: 02f5ff24-8ac7-420f-b8ef-3b4d52919495] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:14.376915 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a6381378-5b5a-4ec1-a8ad-7e913f49459a tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:14.377363 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a6381378-5b5a-4ec1-a8ad-7e913f49459a tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:14.378161 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a6381378-5b5a-4ec1-a8ad-7e913f49459a tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:14.378596 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a6381378-5b5a-4ec1-a8ad-7e913f49459a tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:14.392093 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-a6381378-5b5a-4ec1-a8ad-7e913f49459a tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] HTTP exception thrown: Instance 02f5ff24-8ac7-420f-b8ef-3b4d52919495 could not be found. Nov 23 07:47:14.392703 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a6381378-5b5a-4ec1-a8ad-7e913f49459a tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] Returning 404 to user: Instance 02f5ff24-8ac7-420f-b8ef-3b4d52919495 could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:47:14.393515 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a6381378-5b5a-4ec1-a8ad-7e913f49459a tempest-VolumesSnapshotTestJSON-1707220650 tempest-VolumesSnapshotTestJSON-1707220650-project] 10.222.0.48 "GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495" status: 404 len: 111 microversion: 2.1 time: 0.027101 Nov 23 07:47:14.394083 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 341/655] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:47:14 2021] GET /compute/v2.1/servers/02f5ff24-8ac7-420f-b8ef-3b4d52919495 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:47:15.054594 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-34f6e2f1-b68f-4fac-ab7d-38fbd0e8e5a5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:15.055202 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-34f6e2f1-b68f-4fac-ab7d-38fbd0e8e5a5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:15.062875 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-34f6e2f1-b68f-4fac-ab7d-38fbd0e8e5a5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:15.063366 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-34f6e2f1-b68f-4fac-ab7d-38fbd0e8e5a5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:15.064263 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-34f6e2f1-b68f-4fac-ab7d-38fbd0e8e5a5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:15.065000 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-34f6e2f1-b68f-4fac-ab7d-38fbd0e8e5a5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:15.214000 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-34f6e2f1-b68f-4fac-ab7d-38fbd0e8e5a5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:15.221770 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-34f6e2f1-b68f-4fac-ab7d-38fbd0e8e5a5 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1755 microversion: 2.1 time: 0.171433 Nov 23 07:47:15.222346 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 315/656] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:47:15 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:47:16.239076 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a3ed1600-01d4-4381-90e0-ef6d3149dcc8 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:16.240192 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a3ed1600-01d4-4381-90e0-ef6d3149dcc8 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:16.246667 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a3ed1600-01d4-4381-90e0-ef6d3149dcc8 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:16.247041 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a3ed1600-01d4-4381-90e0-ef6d3149dcc8 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:16.247827 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a3ed1600-01d4-4381-90e0-ef6d3149dcc8 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:16.248337 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a3ed1600-01d4-4381-90e0-ef6d3149dcc8 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:16.395591 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a3ed1600-01d4-4381-90e0-ef6d3149dcc8 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:16.403487 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a3ed1600-01d4-4381-90e0-ef6d3149dcc8 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1758 microversion: 2.1 time: 0.168087 Nov 23 07:47:16.404057 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 342/657] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:47:16 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:47:30.910336 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ae9e6d4f-85ff-4d7e-a6dc-ce99b8789391 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:30.911465 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ae9e6d4f-85ff-4d7e-a6dc-ce99b8789391 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:30.918188 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ae9e6d4f-85ff-4d7e-a6dc-ce99b8789391 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:30.918669 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ae9e6d4f-85ff-4d7e-a6dc-ce99b8789391 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:30.919761 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ae9e6d4f-85ff-4d7e-a6dc-ce99b8789391 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:30.920409 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ae9e6d4f-85ff-4d7e-a6dc-ce99b8789391 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:30.955292 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ae9e6d4f-85ff-4d7e-a6dc-ce99b8789391 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/os-volume_attachments/429d8e19-c9dc-4e98-abaf-e393fa581c28" status: 200 len: 194 microversion: 2.20 time: 0.048677 Nov 23 07:47:30.956200 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 316/658] 10.222.0.48 () {60 vars in 1453 bytes} [Tue Nov 23 07:47:30 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/os-volume_attachments/429d8e19-c9dc-4e98-abaf-e393fa581c28 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:47:31.099185 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-aa03948e-85bf-4d2a-850f-6e3924384503 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:31.099757 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-aa03948e-85bf-4d2a-850f-6e3924384503 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:31.105766 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aa03948e-85bf-4d2a-850f-6e3924384503 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:31.106230 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aa03948e-85bf-4d2a-850f-6e3924384503 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:31.107038 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aa03948e-85bf-4d2a-850f-6e3924384503 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:31.118107 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-aa03948e-85bf-4d2a-850f-6e3924384503 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:31.213464 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.objects.instance [None req-aa03948e-85bf-4d2a-850f-6e3924384503 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lazy-loading 'services' on Instance uuid bb841a35-6344-43a0-85d2-6de8116759b1 {{(pid=122786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:47:31.344169 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-aa03948e-85bf-4d2a-850f-6e3924384503 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/os-volume_attachments/429d8e19-c9dc-4e98-abaf-e393fa581c28" status: 202 len: 0 microversion: 2.20 time: 0.249393 Nov 23 07:47:31.345960 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 343/659] 10.222.0.48 () {60 vars in 1456 bytes} [Tue Nov 23 07:47:31 2021] DELETE /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/os-volume_attachments/429d8e19-c9dc-4e98-abaf-e393fa581c28 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 23 07:47:31.363589 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3fd1b187-adfd-485a-b842-a16a83a5c502 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:31.365202 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3fd1b187-adfd-485a-b842-a16a83a5c502 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:31.376081 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3fd1b187-adfd-485a-b842-a16a83a5c502 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:31.376875 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3fd1b187-adfd-485a-b842-a16a83a5c502 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:31.378447 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3fd1b187-adfd-485a-b842-a16a83a5c502 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:31.379428 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3fd1b187-adfd-485a-b842-a16a83a5c502 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:31.424851 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3fd1b187-adfd-485a-b842-a16a83a5c502 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069917 Nov 23 07:47:31.425884 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 317/660] 10.222.0.48 () {60 vars in 1342 bytes} [Tue Nov 23 07:47:31 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:47:32.445383 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e9f13f8b-616e-4907-bb5f-97e5ca365953 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:32.447519 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e9f13f8b-616e-4907-bb5f-97e5ca365953 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:32.458686 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e9f13f8b-616e-4907-bb5f-97e5ca365953 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:32.459750 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e9f13f8b-616e-4907-bb5f-97e5ca365953 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:32.461537 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e9f13f8b-616e-4907-bb5f-97e5ca365953 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:32.462387 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e9f13f8b-616e-4907-bb5f-97e5ca365953 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:32.528546 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e9f13f8b-616e-4907-bb5f-97e5ca365953 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.092949 Nov 23 07:47:32.529826 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 344/661] 10.222.0.48 () {60 vars in 1342 bytes} [Tue Nov 23 07:47:32 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:47:32.600836 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-9ec11932-8ebc-48a7-8f0e-fb5b2b374159 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:32.601390 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-9ec11932-8ebc-48a7-8f0e-fb5b2b374159 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:32.608047 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9ec11932-8ebc-48a7-8f0e-fb5b2b374159 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:32.608540 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9ec11932-8ebc-48a7-8f0e-fb5b2b374159 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:32.609606 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9ec11932-8ebc-48a7-8f0e-fb5b2b374159 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:32.610109 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9ec11932-8ebc-48a7-8f0e-fb5b2b374159 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:32.638842 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-9ec11932-8ebc-48a7-8f0e-fb5b2b374159 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Going to try to terminate instance {{(pid=122785) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:47:32.759022 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-9ec11932-8ebc-48a7-8f0e-fb5b2b374159 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 204 len: 0 microversion: 2.20 time: 0.161380 Nov 23 07:47:32.760319 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 318/662] 10.222.0.48 () {60 vars in 1279 bytes} [Tue Nov 23 07:47:32 2021] DELETE /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 23 07:47:32.768076 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-876cdd55-86af-4b39-a33b-ac2568c07680 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:32.768833 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-876cdd55-86af-4b39-a33b-ac2568c07680 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:32.775732 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-876cdd55-86af-4b39-a33b-ac2568c07680 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:32.776235 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-876cdd55-86af-4b39-a33b-ac2568c07680 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:32.777134 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-876cdd55-86af-4b39-a33b-ac2568c07680 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:32.777611 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-876cdd55-86af-4b39-a33b-ac2568c07680 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:32.947715 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-876cdd55-86af-4b39-a33b-ac2568c07680 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:32.972383 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-876cdd55-86af-4b39-a33b-ac2568c07680 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:32.974303 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-876cdd55-86af-4b39-a33b-ac2568c07680 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:32.976644 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-876cdd55-86af-4b39-a33b-ac2568c07680 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.211538 Nov 23 07:47:32.977408 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 345/663] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:47:32 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:47:33.999883 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-6453fc82-59d0-484f-9156-6e4a363929dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:34.001112 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-6453fc82-59d0-484f-9156-6e4a363929dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:34.013107 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6453fc82-59d0-484f-9156-6e4a363929dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:34.013107 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6453fc82-59d0-484f-9156-6e4a363929dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:34.014294 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6453fc82-59d0-484f-9156-6e4a363929dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:34.015209 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6453fc82-59d0-484f-9156-6e4a363929dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:34.211683 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-6453fc82-59d0-484f-9156-6e4a363929dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:34.221121 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-6453fc82-59d0-484f-9156-6e4a363929dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:34.222585 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-6453fc82-59d0-484f-9156-6e4a363929dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:34.224332 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-6453fc82-59d0-484f-9156-6e4a363929dc tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.229132 Nov 23 07:47:34.224707 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 319/664] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:47:33 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:47:35.252340 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-2ae2021e-d9f7-4607-8fc2-289e9e62157a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:35.253364 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-2ae2021e-d9f7-4607-8fc2-289e9e62157a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:35.268498 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2ae2021e-d9f7-4607-8fc2-289e9e62157a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:35.269379 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2ae2021e-d9f7-4607-8fc2-289e9e62157a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:35.271180 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2ae2021e-d9f7-4607-8fc2-289e9e62157a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:35.272111 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2ae2021e-d9f7-4607-8fc2-289e9e62157a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:35.493008 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2ae2021e-d9f7-4607-8fc2-289e9e62157a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:35.502657 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2ae2021e-d9f7-4607-8fc2-289e9e62157a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:35.505777 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2ae2021e-d9f7-4607-8fc2-289e9e62157a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:35.508983 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-2ae2021e-d9f7-4607-8fc2-289e9e62157a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1721 microversion: 2.20 time: 0.260105 Nov 23 07:47:35.523557 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 346/665] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:47:35 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1721 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:47:36.129382 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-27b77c6f-239b-4ff5-8c64-41d46a3cc676 req-fb541a7d-17e3-4a69-87ba-d01f8f6e2a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb841a35-6344-43a0-85d2-6de8116759b1", "name": "network-vif-deleted", "tag": "8b4fce4b-5f2b-4eea-8335-5d57ac70511e"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:47:36.132443 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:47:36.132443 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:47:36.145324 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-27b77c6f-239b-4ff5-8c64-41d46a3cc676 req-fb541a7d-17e3-4a69-87ba-d01f8f6e2a40 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:36.146104 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-27b77c6f-239b-4ff5-8c64-41d46a3cc676 req-fb541a7d-17e3-4a69-87ba-d01f8f6e2a40 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:36.168656 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-27b77c6f-239b-4ff5-8c64-41d46a3cc676 req-fb541a7d-17e3-4a69-87ba-d01f8f6e2a40 service nova] Creating event network-vif-deleted:8b4fce4b-5f2b-4eea-8335-5d57ac70511e for instance bb841a35-6344-43a0-85d2-6de8116759b1 on hv-cinder-80403 Nov 23 07:47:36.179111 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-27b77c6f-239b-4ff5-8c64-41d46a3cc676 req-fb541a7d-17e3-4a69-87ba-d01f8f6e2a40 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056002 Nov 23 07:47:36.180880 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 320/666] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:47:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:47:36.537674 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e95e2d58-3ebe-46ee-ad48-757b84fb8237 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:36.539906 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e95e2d58-3ebe-46ee-ad48-757b84fb8237 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:36.553177 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e95e2d58-3ebe-46ee-ad48-757b84fb8237 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:36.554084 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e95e2d58-3ebe-46ee-ad48-757b84fb8237 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:36.556302 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e95e2d58-3ebe-46ee-ad48-757b84fb8237 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:36.557347 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e95e2d58-3ebe-46ee-ad48-757b84fb8237 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:36.606605 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e95e2d58-3ebe-46ee-ad48-757b84fb8237 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:36.607139 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e95e2d58-3ebe-46ee-ad48-757b84fb8237 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:36.607829 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.objects.instance [None req-e95e2d58-3ebe-46ee-ad48-757b84fb8237 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lazy-loading 'fault' on Instance uuid bb841a35-6344-43a0-85d2-6de8116759b1 {{(pid=122786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:47:36.685122 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-e95e2d58-3ebe-46ee-ad48-757b84fb8237 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:36.700262 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-e95e2d58-3ebe-46ee-ad48-757b84fb8237 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:36.704928 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-e95e2d58-3ebe-46ee-ad48-757b84fb8237 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:36.707991 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e95e2d58-3ebe-46ee-ad48-757b84fb8237 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 200 len: 1370 microversion: 2.20 time: 0.179125 Nov 23 07:47:36.708879 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 347/667] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:47:36 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:47:37.733559 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-b68ab00c-c3b4-4a1a-9d44-ae1478ea8a10 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:37.735833 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-b68ab00c-c3b4-4a1a-9d44-ae1478ea8a10 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:37.744283 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b68ab00c-c3b4-4a1a-9d44-ae1478ea8a10 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:37.745019 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b68ab00c-c3b4-4a1a-9d44-ae1478ea8a10 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:37.746124 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b68ab00c-c3b4-4a1a-9d44-ae1478ea8a10 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:37.746873 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b68ab00c-c3b4-4a1a-9d44-ae1478ea8a10 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:37.763926 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-b68ab00c-c3b4-4a1a-9d44-ae1478ea8a10 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] HTTP exception thrown: Instance bb841a35-6344-43a0-85d2-6de8116759b1 could not be found. Nov 23 07:47:37.764806 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-b68ab00c-c3b4-4a1a-9d44-ae1478ea8a10 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Returning 404 to user: Instance bb841a35-6344-43a0-85d2-6de8116759b1 could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:47:37.765967 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-b68ab00c-c3b4-4a1a-9d44-ae1478ea8a10 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 404 len: 111 microversion: 2.20 time: 0.037283 Nov 23 07:47:37.766788 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 321/668] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:47:37 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 23 07:47:37.778451 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e463ef7e-6d24-4489-8d31-851d67cb5939 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '.version_select at 0x7f051469fc10>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:37.807901 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e463ef7e-6d24-4489-8d31-851d67cb5939 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-109841872" status: 204 len: 0 microversion: 2.20 time: 0.034039 Nov 23 07:47:37.813113 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 348/669] 10.222.0.48 () {60 vars in 1258 bytes} [Tue Nov 23 07:47:37 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-109841872 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 07:47:38.760511 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-db97ffbf-4141-4078-a629-41a352ab6510 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'create', calling method: .version_select at 0x7f051406f1f0>, body: {"keypair": {"name": "tempest-keypair-968653804"}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:47:38.790654 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-db97ffbf-4141-4078-a629-41a352ab6510 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Getting quotas for project edd4c40a2d5e481eadb2fc728cc0ca5a. Resources: {'key_pairs'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:47:38.798745 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-db97ffbf-4141-4078-a629-41a352ab6510 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Getting quotas for user 204926c3a4fe4664bc1cd685b57fe015 and project edd4c40a2d5e481eadb2fc728cc0ca5a. Resources: {'key_pairs'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:47:39.330902 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-db97ffbf-4141-4078-a629-41a352ab6510 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Getting quotas for project edd4c40a2d5e481eadb2fc728cc0ca5a. Resources: {'key_pairs'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:47:39.339519 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-db97ffbf-4141-4078-a629-41a352ab6510 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Getting quotas for user 204926c3a4fe4664bc1cd685b57fe015 and project edd4c40a2d5e481eadb2fc728cc0ca5a. Resources: {'key_pairs'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:47:39.365736 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-db97ffbf-4141-4078-a629-41a352ab6510 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.610948 Nov 23 07:47:39.367778 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 322/670] 10.222.0.48 () {62 vars in 1198 bytes} [Tue Nov 23 07:47:38 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 614 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 23 07:47:41.079351 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8c133574-111f-4c3f-a6b3-35c589edbd1b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-20503729", "imageRef": "6895b3b6-16b9-4e43-bf1b-c19e73615ca8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d9cb767d-e579-4bd6-9168-0f1ea7c41329"}], "security_groups": [{"name": "tempest-securitygroup--2123157113"}], "key_name": "tempest-keypair-968653804", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:47:41.202240 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.network.neutron [None req-8c133574-111f-4c3f-a6b3-35c589edbd1b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] validate_networks() for [('d9cb767d-e579-4bd6-9168-0f1ea7c41329', None, None, None, None, None)] {{(pid=122786) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:47:41.672302 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-8c133574-111f-4c3f-a6b3-35c589edbd1b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Flavor limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:47:41.672773 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-8c133574-111f-4c3f-a6b3-35c589edbd1b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Image limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:47:41.673258 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-8c133574-111f-4c3f-a6b3-35c589edbd1b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Flavor pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:47:41.673678 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-8c133574-111f-4c3f-a6b3-35c589edbd1b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Image pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:47:41.674131 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-8c133574-111f-4c3f-a6b3-35c589edbd1b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:47:41.684040 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8c133574-111f-4c3f-a6b3-35c589edbd1b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:41.684493 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8c133574-111f-4c3f-a6b3-35c589edbd1b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:41.685322 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8c133574-111f-4c3f-a6b3-35c589edbd1b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:41.685814 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8c133574-111f-4c3f-a6b3-35c589edbd1b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:41.706712 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-8c133574-111f-4c3f-a6b3-35c589edbd1b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Getting quotas for project edd4c40a2d5e481eadb2fc728cc0ca5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:47:41.715492 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-8c133574-111f-4c3f-a6b3-35c589edbd1b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Getting quotas for user 204926c3a4fe4664bc1cd685b57fe015 and project edd4c40a2d5e481eadb2fc728cc0ca5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:47:41.736898 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8c133574-111f-4c3f-a6b3-35c589edbd1b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Going to run 1 instances... {{(pid=122786) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:47:41.742314 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8c133574-111f-4c3f-a6b3-35c589edbd1b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6895b3b6-16b9-4e43-bf1b-c19e73615ca8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:47:41.807745 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-8c133574-111f-4c3f-a6b3-35c589edbd1b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.732234 Nov 23 07:47:41.808859 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 349/671] 10.222.0.48 () {62 vars in 1187 bytes} [Tue Nov 23 07:47:41 2021] POST /compute/v2.1/servers => generated 402 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 23 07:47:41.821378 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-0a58a2af-7d96-4224-b79d-92378c3519df tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:41.822512 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-0a58a2af-7d96-4224-b79d-92378c3519df tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:41.904694 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0a58a2af-7d96-4224-b79d-92378c3519df tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:41.917790 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0a58a2af-7d96-4224-b79d-92378c3519df tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:41.920621 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0a58a2af-7d96-4224-b79d-92378c3519df tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:41.922568 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-0a58a2af-7d96-4224-b79d-92378c3519df tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1279 microversion: 2.20 time: 0.106100 Nov 23 07:47:41.923472 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 323/672] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:47:41 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1279 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:47:42.944437 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-5fbe886a-1855-4f86-a69c-9aebc9711b86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:42.945284 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-5fbe886a-1855-4f86-a69c-9aebc9711b86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:42.953695 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5fbe886a-1855-4f86-a69c-9aebc9711b86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:42.954276 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5fbe886a-1855-4f86-a69c-9aebc9711b86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:42.955589 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5fbe886a-1855-4f86-a69c-9aebc9711b86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:42.956260 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5fbe886a-1855-4f86-a69c-9aebc9711b86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:43.063593 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5fbe886a-1855-4f86-a69c-9aebc9711b86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:43.075314 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5fbe886a-1855-4f86-a69c-9aebc9711b86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:43.077848 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5fbe886a-1855-4f86-a69c-9aebc9711b86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:43.079010 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-5fbe886a-1855-4f86-a69c-9aebc9711b86 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1331 microversion: 2.20 time: 0.140051 Nov 23 07:47:43.079619 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 350/673] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:47:42 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1331 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:47:44.099804 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-b1af996d-4acb-4d19-b863-84b6a7d766b1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:44.101082 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-b1af996d-4acb-4d19-b863-84b6a7d766b1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:44.109909 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b1af996d-4acb-4d19-b863-84b6a7d766b1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:44.110671 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b1af996d-4acb-4d19-b863-84b6a7d766b1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:44.112077 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b1af996d-4acb-4d19-b863-84b6a7d766b1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:44.112703 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b1af996d-4acb-4d19-b863-84b6a7d766b1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:44.435653 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-b1af996d-4acb-4d19-b863-84b6a7d766b1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:44.445067 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-b1af996d-4acb-4d19-b863-84b6a7d766b1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:44.446646 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-b1af996d-4acb-4d19-b863-84b6a7d766b1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:44.448240 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-b1af996d-4acb-4d19-b863-84b6a7d766b1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1405 microversion: 2.20 time: 0.353443 Nov 23 07:47:44.450072 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 324/674] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:47:44 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1405 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:47:45.079024 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-cb8d60ad-93fd-4012-ab72-ee63407044a9 req-d24b8eda-ba82-4688-9990-866d94d12984 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36d02284-ac69-4605-bd8e-1c29644f219c", "tag": "7bb628ce-17b8-43a9-8265-270514936b86"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:47:45.092128 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:47:45.092128 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:47:45.112337 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-cb8d60ad-93fd-4012-ab72-ee63407044a9 req-d24b8eda-ba82-4688-9990-866d94d12984 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:45.115135 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-cb8d60ad-93fd-4012-ab72-ee63407044a9 req-d24b8eda-ba82-4688-9990-866d94d12984 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:45.162509 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-cb8d60ad-93fd-4012-ab72-ee63407044a9 req-d24b8eda-ba82-4688-9990-866d94d12984 service nova] Creating event network-changed:7bb628ce-17b8-43a9-8265-270514936b86 for instance 36d02284-ac69-4605-bd8e-1c29644f219c on hv-cinder-80403 Nov 23 07:47:45.180435 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-cb8d60ad-93fd-4012-ab72-ee63407044a9 req-d24b8eda-ba82-4688-9990-866d94d12984 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116610 Nov 23 07:47:45.181972 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 351/675] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:47:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:47:45.484401 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-0eeb439c-c883-4e2c-8f48-65a035e3902e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:45.485517 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-0eeb439c-c883-4e2c-8f48-65a035e3902e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:45.497315 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0eeb439c-c883-4e2c-8f48-65a035e3902e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:45.498153 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0eeb439c-c883-4e2c-8f48-65a035e3902e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:45.499717 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0eeb439c-c883-4e2c-8f48-65a035e3902e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:45.500522 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0eeb439c-c883-4e2c-8f48-65a035e3902e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:45.733485 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0eeb439c-c883-4e2c-8f48-65a035e3902e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:45.743096 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0eeb439c-c883-4e2c-8f48-65a035e3902e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:45.744829 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0eeb439c-c883-4e2c-8f48-65a035e3902e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:45.746602 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-0eeb439c-c883-4e2c-8f48-65a035e3902e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1405 microversion: 2.20 time: 0.269612 Nov 23 07:47:45.747756 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 325/676] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:47:45 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1405 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:47:46.776460 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b88c8b0c-09fd-44f2-9d24-0b7a9558ed20 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:46.777188 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-b88c8b0c-09fd-44f2-9d24-0b7a9558ed20 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:46.784872 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b88c8b0c-09fd-44f2-9d24-0b7a9558ed20 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:46.786660 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b88c8b0c-09fd-44f2-9d24-0b7a9558ed20 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:46.786994 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b88c8b0c-09fd-44f2-9d24-0b7a9558ed20 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:46.788640 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b88c8b0c-09fd-44f2-9d24-0b7a9558ed20 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:46.941352 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b88c8b0c-09fd-44f2-9d24-0b7a9558ed20 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:46.950185 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b88c8b0c-09fd-44f2-9d24-0b7a9558ed20 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:46.951831 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b88c8b0c-09fd-44f2-9d24-0b7a9558ed20 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:46.953104 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b88c8b0c-09fd-44f2-9d24-0b7a9558ed20 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1405 microversion: 2.20 time: 0.181071 Nov 23 07:47:46.953896 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 352/677] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:47:46 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:47:47.972399 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-9bf776d6-517c-48c3-8f73-427e4f36864a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:47.973171 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-9bf776d6-517c-48c3-8f73-427e4f36864a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:47.980631 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9bf776d6-517c-48c3-8f73-427e4f36864a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:47.981212 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9bf776d6-517c-48c3-8f73-427e4f36864a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:47.982189 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9bf776d6-517c-48c3-8f73-427e4f36864a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:47.982727 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9bf776d6-517c-48c3-8f73-427e4f36864a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:48.161754 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-9bf776d6-517c-48c3-8f73-427e4f36864a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:48.176103 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-9bf776d6-517c-48c3-8f73-427e4f36864a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:48.179659 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-9bf776d6-517c-48c3-8f73-427e4f36864a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:48.181396 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-9bf776d6-517c-48c3-8f73-427e4f36864a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1405 microversion: 2.20 time: 0.212907 Nov 23 07:47:48.182259 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 326/678] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:47:47 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:47:49.212277 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c4f14c2e-75f4-4d6a-9afe-c2f8821f4333 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:49.212277 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c4f14c2e-75f4-4d6a-9afe-c2f8821f4333 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:49.216646 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c4f14c2e-75f4-4d6a-9afe-c2f8821f4333 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:49.217226 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c4f14c2e-75f4-4d6a-9afe-c2f8821f4333 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:49.218105 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c4f14c2e-75f4-4d6a-9afe-c2f8821f4333 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:49.218541 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c4f14c2e-75f4-4d6a-9afe-c2f8821f4333 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:49.400103 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-c4f14c2e-75f4-4d6a-9afe-c2f8821f4333 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:49.409125 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-c4f14c2e-75f4-4d6a-9afe-c2f8821f4333 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:49.411246 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-c4f14c2e-75f4-4d6a-9afe-c2f8821f4333 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:49.412666 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c4f14c2e-75f4-4d6a-9afe-c2f8821f4333 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1405 microversion: 2.20 time: 0.207564 Nov 23 07:47:49.413248 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 353/679] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:47:49 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:47:50.440458 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c9dd4ba2-68bd-4672-998c-f0efdd47d748 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:50.441041 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c9dd4ba2-68bd-4672-998c-f0efdd47d748 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:50.448906 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c9dd4ba2-68bd-4672-998c-f0efdd47d748 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:50.449352 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c9dd4ba2-68bd-4672-998c-f0efdd47d748 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:50.450206 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c9dd4ba2-68bd-4672-998c-f0efdd47d748 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:50.450657 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c9dd4ba2-68bd-4672-998c-f0efdd47d748 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:50.618466 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c9dd4ba2-68bd-4672-998c-f0efdd47d748 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:50.628181 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c9dd4ba2-68bd-4672-998c-f0efdd47d748 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:50.630350 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c9dd4ba2-68bd-4672-998c-f0efdd47d748 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:50.631501 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c9dd4ba2-68bd-4672-998c-f0efdd47d748 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1405 microversion: 2.20 time: 0.195336 Nov 23 07:47:50.632073 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 327/680] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:47:50 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:47:50.794689 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-73c326a8-4b82-4e94-bb31-fa8be648dc59 req-5930c1a9-397a-4adb-990b-bf06ec2651cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d02284-ac69-4605-bd8e-1c29644f219c", "name": "network-vif-plugged", "status": "completed", "tag": "7bb628ce-17b8-43a9-8265-270514936b86"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:47:50.796938 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:47:50.796938 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:47:50.805345 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-73c326a8-4b82-4e94-bb31-fa8be648dc59 req-5930c1a9-397a-4adb-990b-bf06ec2651cf service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:50.805808 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-73c326a8-4b82-4e94-bb31-fa8be648dc59 req-5930c1a9-397a-4adb-990b-bf06ec2651cf service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:50.818919 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-73c326a8-4b82-4e94-bb31-fa8be648dc59 req-5930c1a9-397a-4adb-990b-bf06ec2651cf service nova] Creating event network-vif-plugged:7bb628ce-17b8-43a9-8265-270514936b86 for instance 36d02284-ac69-4605-bd8e-1c29644f219c on hv-cinder-80403 Nov 23 07:47:50.824501 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-73c326a8-4b82-4e94-bb31-fa8be648dc59 req-5930c1a9-397a-4adb-990b-bf06ec2651cf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033987 Nov 23 07:47:50.825112 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 354/681] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:47:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:47:51.651985 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c285fe10-5780-4572-99d6-e903898dd917 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:51.652818 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c285fe10-5780-4572-99d6-e903898dd917 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:51.660273 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c285fe10-5780-4572-99d6-e903898dd917 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:51.660735 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c285fe10-5780-4572-99d6-e903898dd917 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:51.661854 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c285fe10-5780-4572-99d6-e903898dd917 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:51.662296 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c285fe10-5780-4572-99d6-e903898dd917 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:51.824283 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c285fe10-5780-4572-99d6-e903898dd917 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:51.834912 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c285fe10-5780-4572-99d6-e903898dd917 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:51.836639 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c285fe10-5780-4572-99d6-e903898dd917 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:51.838067 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c285fe10-5780-4572-99d6-e903898dd917 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1405 microversion: 2.20 time: 0.190053 Nov 23 07:47:51.838742 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 328/682] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:47:51 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:47:52.865454 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a982860e-427d-4bd5-abd5-208bd3c98dca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:52.866838 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a982860e-427d-4bd5-abd5-208bd3c98dca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:52.878538 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a982860e-427d-4bd5-abd5-208bd3c98dca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:52.879906 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a982860e-427d-4bd5-abd5-208bd3c98dca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:52.881443 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a982860e-427d-4bd5-abd5-208bd3c98dca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:52.882333 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a982860e-427d-4bd5-abd5-208bd3c98dca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:53.103700 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a982860e-427d-4bd5-abd5-208bd3c98dca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:53.115273 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a982860e-427d-4bd5-abd5-208bd3c98dca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:53.117144 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a982860e-427d-4bd5-abd5-208bd3c98dca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:47:53.118452 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a982860e-427d-4bd5-abd5-208bd3c98dca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1597 microversion: 2.20 time: 0.262431 Nov 23 07:47:53.119385 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 355/683] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:47:52 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1597 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:47:53.148260 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-47059f3e-d7a6-4b3e-b893-fface24fc5ce tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:53.148863 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-47059f3e-d7a6-4b3e-b893-fface24fc5ce tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:53.157596 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-47059f3e-d7a6-4b3e-b893-fface24fc5ce tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:53.158232 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-47059f3e-d7a6-4b3e-b893-fface24fc5ce tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:53.159340 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-47059f3e-d7a6-4b3e-b893-fface24fc5ce tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:53.160571 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-47059f3e-d7a6-4b3e-b893-fface24fc5ce tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:53.260529 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-47059f3e-d7a6-4b3e-b893-fface24fc5ce tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.117090 Nov 23 07:47:53.261533 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 329/684] 10.222.0.48 () {60 vars in 1315 bytes} [Tue Nov 23 07:47:53 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:47:54.595928 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c3d38a9a-662d-47ee-a8e3-fc974e6af8f9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:47:54.608251 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-ccaf1a14-d915-4840-959c-2bafd4ffa23d req-694360b1-fe9c-4c3c-bc2d-be277bdf250e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36d02284-ac69-4605-bd8e-1c29644f219c", "tag": "7bb628ce-17b8-43a9-8265-270514936b86"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:47:54.609894 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c3d38a9a-662d-47ee-a8e3-fc974e6af8f9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:54.611474 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:47:54.611474 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:47:54.619392 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c3d38a9a-662d-47ee-a8e3-fc974e6af8f9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:54.620197 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c3d38a9a-662d-47ee-a8e3-fc974e6af8f9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:54.621542 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c3d38a9a-662d-47ee-a8e3-fc974e6af8f9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:54.622820 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c3d38a9a-662d-47ee-a8e3-fc974e6af8f9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:54.625979 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-ccaf1a14-d915-4840-959c-2bafd4ffa23d req-694360b1-fe9c-4c3c-bc2d-be277bdf250e service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:54.626801 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-ccaf1a14-d915-4840-959c-2bafd4ffa23d req-694360b1-fe9c-4c3c-bc2d-be277bdf250e service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:54.652023 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-ccaf1a14-d915-4840-959c-2bafd4ffa23d req-694360b1-fe9c-4c3c-bc2d-be277bdf250e service nova] Creating event network-changed:7bb628ce-17b8-43a9-8265-270514936b86 for instance 36d02284-ac69-4605-bd8e-1c29644f219c on hv-cinder-80403 Nov 23 07:47:54.662686 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-ccaf1a14-d915-4840-959c-2bafd4ffa23d req-694360b1-fe9c-4c3c-bc2d-be277bdf250e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061831 Nov 23 07:47:54.663712 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 330/685] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:47:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:47:57.353928 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c3d38a9a-662d-47ee-a8e3-fc974e6af8f9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 14 microversion: 2.20 time: 2.766015 Nov 23 07:47:57.354790 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 356/686] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:47:54 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 14 bytes in 2769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:47:58.367153 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ed71dc62-7e41-471c-9220-0e2e6c394a3e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:47:58.368168 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ed71dc62-7e41-471c-9220-0e2e6c394a3e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:58.371767 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-76c57d73-a10a-47ad-b5b4-1d9a228d510b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1154738481"}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:47:58.372910 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-76c57d73-a10a-47ad-b5b4-1d9a228d510b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:58.375631 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ed71dc62-7e41-471c-9220-0e2e6c394a3e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:58.376085 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ed71dc62-7e41-471c-9220-0e2e6c394a3e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:58.376885 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ed71dc62-7e41-471c-9220-0e2e6c394a3e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:58.377322 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ed71dc62-7e41-471c-9220-0e2e6c394a3e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:58.384133 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-76c57d73-a10a-47ad-b5b4-1d9a228d510b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:58.384912 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-76c57d73-a10a-47ad-b5b4-1d9a228d510b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:58.386416 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-76c57d73-a10a-47ad-b5b4-1d9a228d510b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:58.387191 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-76c57d73-a10a-47ad-b5b4-1d9a228d510b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:58.442449 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ed71dc62-7e41-471c-9220-0e2e6c394a3e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 14 microversion: 2.20 time: 0.078530 Nov 23 07:47:58.443136 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 357/687] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:47:58 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:47:58.587207 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.network.security_group_api [None req-76c57d73-a10a-47ad-b5b4-1d9a228d510b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Removing security group ac4d94c8-741e-41a3-a6ad-e0e3518355fe from port 46440f82-0a6b-4d97-82a5-b146d1263ea9 Nov 23 07:47:59.018638 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-76c57d73-a10a-47ad-b5b4-1d9a228d510b tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "POST /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/action" status: 202 len: 0 microversion: 2.1 time: 0.655773 Nov 23 07:47:59.020533 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 331/688] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:47:58 2021] POST /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/action => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:47:59.033761 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-b5fbbc4b-12e2-41b5-9161-86745bf89894 req-3786d559-2369-4476-89d3-c7a42c05628d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "842f1da9-1085-4946-b62b-9ae2c5ad009b", "tag": "46440f82-0a6b-4d97-82a5-b146d1263ea9"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:47:59.039172 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:47:59.039172 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:47:59.045839 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-b5fbbc4b-12e2-41b5-9161-86745bf89894 req-3786d559-2369-4476-89d3-c7a42c05628d service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:59.046582 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-b5fbbc4b-12e2-41b5-9161-86745bf89894 req-3786d559-2369-4476-89d3-c7a42c05628d service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:59.065394 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-b5fbbc4b-12e2-41b5-9161-86745bf89894 req-3786d559-2369-4476-89d3-c7a42c05628d service nova] Creating event network-changed:46440f82-0a6b-4d97-82a5-b146d1263ea9 for instance 842f1da9-1085-4946-b62b-9ae2c5ad009b on hv-cinder-80403 Nov 23 07:47:59.076871 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-b5fbbc4b-12e2-41b5-9161-86745bf89894 req-3786d559-2369-4476-89d3-c7a42c05628d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047844 Nov 23 07:47:59.078218 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 358/689] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:47:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:47:59.312574 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-cf2acf72-613b-4ff9-99ad-d8a9f237103e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:59.315507 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-cf2acf72-613b-4ff9-99ad-d8a9f237103e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:59.335985 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cf2acf72-613b-4ff9-99ad-d8a9f237103e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:59.338078 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cf2acf72-613b-4ff9-99ad-d8a9f237103e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:59.340321 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cf2acf72-613b-4ff9-99ad-d8a9f237103e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:59.341855 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cf2acf72-613b-4ff9-99ad-d8a9f237103e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:59.426742 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-cf2acf72-613b-4ff9-99ad-d8a9f237103e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120536 Nov 23 07:47:59.436075 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 332/690] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:47:59 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d/os-volume_attachments => generated 25 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:47:59.461446 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-0a072286-c27d-4009-a1b6-5be13f5604b4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:47:59.464861 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-0a072286-c27d-4009-a1b6-5be13f5604b4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:59.491714 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0a072286-c27d-4009-a1b6-5be13f5604b4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:59.493534 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0a072286-c27d-4009-a1b6-5be13f5604b4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:59.495591 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0a072286-c27d-4009-a1b6-5be13f5604b4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:59.496505 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0a072286-c27d-4009-a1b6-5be13f5604b4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:59.607086 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-bea39740-917a-426b-9f3b-e20d8acee9c7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:59.608354 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-bea39740-917a-426b-9f3b-e20d8acee9c7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:59.620458 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bea39740-917a-426b-9f3b-e20d8acee9c7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:59.621873 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bea39740-917a-426b-9f3b-e20d8acee9c7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:59.624821 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bea39740-917a-426b-9f3b-e20d8acee9c7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:59.626053 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bea39740-917a-426b-9f3b-e20d8acee9c7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:59.641429 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-0a072286-c27d-4009-a1b6-5be13f5604b4 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 14 microversion: 2.20 time: 0.188818 Nov 23 07:47:59.642363 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 359/691] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:47:59 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 14 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:47:59.691919 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-bea39740-917a-426b-9f3b-e20d8acee9c7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Going to try to terminate instance {{(pid=122785) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:47:59.837877 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-bea39740-917a-426b-9f3b-e20d8acee9c7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "DELETE /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 204 len: 0 microversion: 2.1 time: 0.239066 Nov 23 07:47:59.838888 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 333/692] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:47:59 2021] DELETE /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 07:47:59.866064 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e72d89ac-6609-40db-9d58-3ae8d503e531 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:47:59.866064 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e72d89ac-6609-40db-9d58-3ae8d503e531 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:47:59.871390 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e72d89ac-6609-40db-9d58-3ae8d503e531 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:59.872589 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e72d89ac-6609-40db-9d58-3ae8d503e531 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:47:59.874111 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e72d89ac-6609-40db-9d58-3ae8d503e531 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:47:59.874898 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e72d89ac-6609-40db-9d58-3ae8d503e531 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:00.486108 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-e72d89ac-6609-40db-9d58-3ae8d503e531 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:00.495794 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e72d89ac-6609-40db-9d58-3ae8d503e531 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1674 microversion: 2.1 time: 0.649894 Nov 23 07:48:00.496523 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 360/693] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:47:59 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1674 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:48:00.655954 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f34283bd-3eeb-4a3a-92da-77ed14bd5f2a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:00.658033 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f34283bd-3eeb-4a3a-92da-77ed14bd5f2a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:00.667562 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f34283bd-3eeb-4a3a-92da-77ed14bd5f2a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:00.668283 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f34283bd-3eeb-4a3a-92da-77ed14bd5f2a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:00.669315 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f34283bd-3eeb-4a3a-92da-77ed14bd5f2a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:00.670041 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f34283bd-3eeb-4a3a-92da-77ed14bd5f2a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:00.754953 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f34283bd-3eeb-4a3a-92da-77ed14bd5f2a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 14 microversion: 2.20 time: 0.103281 Nov 23 07:48:00.755941 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 334/694] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:00 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:48:00.783902 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4c2ec060-e189-43c6-aaae-5fc7f4bb7628 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:00.784408 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4c2ec060-e189-43c6-aaae-5fc7f4bb7628 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:00.789353 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-7b47a7f7-90b0-4918-835d-46f99158b8c9 req-38ceb9a2-12e3-4b56-b125-f61a6a0c75b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "842f1da9-1085-4946-b62b-9ae2c5ad009b", "tag": "46440f82-0a6b-4d97-82a5-b146d1263ea9"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:00.790892 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:48:00.790892 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:48:00.791143 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4c2ec060-e189-43c6-aaae-5fc7f4bb7628 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:00.791355 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4c2ec060-e189-43c6-aaae-5fc7f4bb7628 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:00.792145 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4c2ec060-e189-43c6-aaae-5fc7f4bb7628 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:00.792780 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4c2ec060-e189-43c6-aaae-5fc7f4bb7628 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:00.799851 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-7b47a7f7-90b0-4918-835d-46f99158b8c9 req-38ceb9a2-12e3-4b56-b125-f61a6a0c75b2 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:00.800287 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-7b47a7f7-90b0-4918-835d-46f99158b8c9 req-38ceb9a2-12e3-4b56-b125-f61a6a0c75b2 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:00.814529 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-7b47a7f7-90b0-4918-835d-46f99158b8c9 req-38ceb9a2-12e3-4b56-b125-f61a6a0c75b2 service nova] Creating event network-changed:46440f82-0a6b-4d97-82a5-b146d1263ea9 for instance 842f1da9-1085-4946-b62b-9ae2c5ad009b on hv-cinder-80403 Nov 23 07:48:00.820311 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-7b47a7f7-90b0-4918-835d-46f99158b8c9 req-38ceb9a2-12e3-4b56-b125-f61a6a0c75b2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035347 Nov 23 07:48:00.821233 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 335/695] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:48:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:48:00.886321 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.objects.instance [None req-4c2ec060-e189-43c6-aaae-5fc7f4bb7628 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lazy-loading 'services' on Instance uuid 842f1da9-1085-4946-b62b-9ae2c5ad009b {{(pid=122786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:48:00.972866 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4c2ec060-e189-43c6-aaae-5fc7f4bb7628 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "DELETE /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments/e096a1fe-8519-4b77-8d06-5e9183953b17" status: 202 len: 0 microversion: 2.1 time: 0.192531 Nov 23 07:48:00.995615 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 361/696] 10.222.0.48 () {58 vars in 1415 bytes} [Tue Nov 23 07:48:00 2021] DELETE /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments/e096a1fe-8519-4b77-8d06-5e9183953b17 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:01.025118 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-0f905498-06e5-4976-bd17-3702792b6efe tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:01.034215 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-0f905498-06e5-4976-bd17-3702792b6efe tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:01.053209 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0f905498-06e5-4976-bd17-3702792b6efe tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:01.054045 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0f905498-06e5-4976-bd17-3702792b6efe tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:01.057940 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0f905498-06e5-4976-bd17-3702792b6efe tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:01.059124 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0f905498-06e5-4976-bd17-3702792b6efe tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:01.147159 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-0f905498-06e5-4976-bd17-3702792b6efe tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144852 Nov 23 07:48:01.148408 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 336/697] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:48:00 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:48:01.526361 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1bc85d47-0d0c-4645-8558-d01b2c5e26d8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:01.528132 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1bc85d47-0d0c-4645-8558-d01b2c5e26d8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:01.540168 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1bc85d47-0d0c-4645-8558-d01b2c5e26d8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:01.540916 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1bc85d47-0d0c-4645-8558-d01b2c5e26d8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:01.542363 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1bc85d47-0d0c-4645-8558-d01b2c5e26d8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:01.542937 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1bc85d47-0d0c-4645-8558-d01b2c5e26d8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:01.768539 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-225a993d-851a-42ce-8fb5-c653d2f74854 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:01.770943 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-225a993d-851a-42ce-8fb5-c653d2f74854 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:01.778082 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1bc85d47-0d0c-4645-8558-d01b2c5e26d8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:01.781616 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-225a993d-851a-42ce-8fb5-c653d2f74854 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:01.782536 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-225a993d-851a-42ce-8fb5-c653d2f74854 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:01.784148 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-225a993d-851a-42ce-8fb5-c653d2f74854 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:01.784902 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-225a993d-851a-42ce-8fb5-c653d2f74854 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:01.791100 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1bc85d47-0d0c-4645-8558-d01b2c5e26d8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1674 microversion: 2.1 time: 0.278517 Nov 23 07:48:01.792711 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 362/698] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:01 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1674 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:01.860880 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-225a993d-851a-42ce-8fb5-c653d2f74854 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 14 microversion: 2.20 time: 0.096587 Nov 23 07:48:01.864753 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 337/699] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:01 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:48:02.165943 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1fcb4a1e-76fe-49b6-a334-52ba739da26a tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:02.167755 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1fcb4a1e-76fe-49b6-a334-52ba739da26a tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:02.177600 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1fcb4a1e-76fe-49b6-a334-52ba739da26a tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:02.178367 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1fcb4a1e-76fe-49b6-a334-52ba739da26a tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:02.179433 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1fcb4a1e-76fe-49b6-a334-52ba739da26a tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:02.179906 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1fcb4a1e-76fe-49b6-a334-52ba739da26a tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:02.215474 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1fcb4a1e-76fe-49b6-a334-52ba739da26a tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057493 Nov 23 07:48:02.217239 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 363/700] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:48:02 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:48:02.815914 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-cae46f0c-ded8-4b7c-85c1-d565eb7dd385 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:02.816773 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-cae46f0c-ded8-4b7c-85c1-d565eb7dd385 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:02.824064 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cae46f0c-ded8-4b7c-85c1-d565eb7dd385 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:02.824510 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cae46f0c-ded8-4b7c-85c1-d565eb7dd385 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:02.825404 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cae46f0c-ded8-4b7c-85c1-d565eb7dd385 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:02.825797 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cae46f0c-ded8-4b7c-85c1-d565eb7dd385 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:02.876631 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b81a1306-3d5e-4264-803d-be5d66875141 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:02.878291 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-b81a1306-3d5e-4264-803d-be5d66875141 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:02.890757 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b81a1306-3d5e-4264-803d-be5d66875141 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:02.891569 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b81a1306-3d5e-4264-803d-be5d66875141 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:02.893069 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b81a1306-3d5e-4264-803d-be5d66875141 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:02.893966 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b81a1306-3d5e-4264-803d-be5d66875141 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:02.986711 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b81a1306-3d5e-4264-803d-be5d66875141 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 14 microversion: 2.20 time: 0.117256 Nov 23 07:48:02.987729 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 364/701] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:02 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:48:03.004488 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-cae46f0c-ded8-4b7c-85c1-d565eb7dd385 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:03.014217 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-cae46f0c-ded8-4b7c-85c1-d565eb7dd385 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 200 len: 1606 microversion: 2.1 time: 0.202454 Nov 23 07:48:03.015060 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 338/702] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:02 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 1606 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:48:03.137847 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-6fcb4c53-b9a3-4086-82f7-7ea720c78bdd req-4f1fc4dd-e966-4301-b259-5648309f4b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c2d383-cc82-4479-b0fe-d92e63ef538d", "name": "network-vif-deleted", "tag": "12786728-e083-4cb6-b178-3facabd226a9"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:03.139428 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:48:03.139428 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:48:03.147882 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-6fcb4c53-b9a3-4086-82f7-7ea720c78bdd req-4f1fc4dd-e966-4301-b259-5648309f4b56 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:03.148332 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-6fcb4c53-b9a3-4086-82f7-7ea720c78bdd req-4f1fc4dd-e966-4301-b259-5648309f4b56 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:03.172330 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-6fcb4c53-b9a3-4086-82f7-7ea720c78bdd req-4f1fc4dd-e966-4301-b259-5648309f4b56 service nova] Creating event network-vif-deleted:12786728-e083-4cb6-b178-3facabd226a9 for instance 28c2d383-cc82-4479-b0fe-d92e63ef538d on hv-cinder-80403 Nov 23 07:48:03.185693 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-6fcb4c53-b9a3-4086-82f7-7ea720c78bdd req-4f1fc4dd-e966-4301-b259-5648309f4b56 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051339 Nov 23 07:48:03.187904 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 365/703] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:48:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:48:03.228856 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c53cc3a4-74ca-4b78-a95f-9e7b7c777ad1 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:03.229941 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c53cc3a4-74ca-4b78-a95f-9e7b7c777ad1 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:03.244724 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c53cc3a4-74ca-4b78-a95f-9e7b7c777ad1 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:03.245388 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c53cc3a4-74ca-4b78-a95f-9e7b7c777ad1 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:03.246268 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c53cc3a4-74ca-4b78-a95f-9e7b7c777ad1 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:03.246709 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c53cc3a4-74ca-4b78-a95f-9e7b7c777ad1 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:03.322839 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c53cc3a4-74ca-4b78-a95f-9e7b7c777ad1 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097467 Nov 23 07:48:03.324924 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 339/704] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:48:03 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:48:04.000965 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6736c181-edd7-4d2d-956f-2f1ab2a77e8d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:04.002660 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6736c181-edd7-4d2d-956f-2f1ab2a77e8d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:04.015018 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6736c181-edd7-4d2d-956f-2f1ab2a77e8d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:04.017722 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6736c181-edd7-4d2d-956f-2f1ab2a77e8d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:04.020112 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6736c181-edd7-4d2d-956f-2f1ab2a77e8d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:04.021177 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6736c181-edd7-4d2d-956f-2f1ab2a77e8d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:04.036571 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-57dfd4ef-906e-4f1d-953f-03bc2a2e18b8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:04.038059 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-57dfd4ef-906e-4f1d-953f-03bc2a2e18b8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:04.047107 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-57dfd4ef-906e-4f1d-953f-03bc2a2e18b8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:04.048630 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-57dfd4ef-906e-4f1d-953f-03bc2a2e18b8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:04.049832 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-57dfd4ef-906e-4f1d-953f-03bc2a2e18b8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:04.051054 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-57dfd4ef-906e-4f1d-953f-03bc2a2e18b8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:04.072232 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-57dfd4ef-906e-4f1d-953f-03bc2a2e18b8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] HTTP exception thrown: Instance 28c2d383-cc82-4479-b0fe-d92e63ef538d could not be found. Nov 23 07:48:04.073302 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-57dfd4ef-906e-4f1d-953f-03bc2a2e18b8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Returning 404 to user: Instance 28c2d383-cc82-4479-b0fe-d92e63ef538d could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:48:04.074528 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-57dfd4ef-906e-4f1d-953f-03bc2a2e18b8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 404 len: 111 microversion: 2.1 time: 0.043209 Nov 23 07:48:04.079981 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 340/705] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:04 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:48:04.090741 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-0391af67-af87-4eaf-b253-ea6cd30107fd tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '.version_select at 0x7f05140485e0>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:04.117014 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6736c181-edd7-4d2d-956f-2f1ab2a77e8d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 14 microversion: 2.20 time: 0.120948 Nov 23 07:48:04.117869 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 366/706] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:03 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:04.126326 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-0391af67-af87-4eaf-b253-ea6cd30107fd tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190121129" status: 202 len: 0 microversion: 2.1 time: 0.044814 Nov 23 07:48:04.127029 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 341/707] 10.222.0.48 () {58 vars in 1220 bytes} [Tue Nov 23 07:48:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190121129 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:04.337695 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1e8dc703-d89a-443b-ab34-5233913ead3c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:04.338778 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1e8dc703-d89a-443b-ab34-5233913ead3c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:04.355755 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e8dc703-d89a-443b-ab34-5233913ead3c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:04.356243 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e8dc703-d89a-443b-ab34-5233913ead3c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:04.357047 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e8dc703-d89a-443b-ab34-5233913ead3c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:04.357486 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e8dc703-d89a-443b-ab34-5233913ead3c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:04.414113 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1e8dc703-d89a-443b-ab34-5233913ead3c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080556 Nov 23 07:48:04.418246 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 367/708] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:48:04 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:48:05.135966 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-89534982-cc18-4c64-a93e-340149827d46 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:05.137531 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-89534982-cc18-4c64-a93e-340149827d46 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:05.139429 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d7891052-4221-4a98-81fd-df31844a46e4 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'create', calling method: .version_select at 0x7f0514771dc0>, body: {"keypair": {"name": "tempest-keypair-528478556"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:05.153347 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-89534982-cc18-4c64-a93e-340149827d46 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:05.154092 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-89534982-cc18-4c64-a93e-340149827d46 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:05.155555 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-89534982-cc18-4c64-a93e-340149827d46 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:05.156301 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-89534982-cc18-4c64-a93e-340149827d46 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:05.158150 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-d7891052-4221-4a98-81fd-df31844a46e4 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Getting quotas for project bc7f91007a2a4b90b80701592589a131. Resources: {'key_pairs'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:48:05.163355 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-d7891052-4221-4a98-81fd-df31844a46e4 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Getting quotas for user 6a88554481924707acaf2afd81d18793 and project bc7f91007a2a4b90b80701592589a131. Resources: {'key_pairs'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:48:05.243690 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-89534982-cc18-4c64-a93e-340149827d46 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 14 microversion: 2.20 time: 0.116404 Nov 23 07:48:05.247768 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 342/709] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:05 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:05.371887 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-d7891052-4221-4a98-81fd-df31844a46e4 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Getting quotas for project bc7f91007a2a4b90b80701592589a131. Resources: {'key_pairs'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:48:05.376361 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-d7891052-4221-4a98-81fd-df31844a46e4 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Getting quotas for user 6a88554481924707acaf2afd81d18793 and project bc7f91007a2a4b90b80701592589a131. Resources: {'key_pairs'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:48:05.392410 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d7891052-4221-4a98-81fd-df31844a46e4 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.257803 Nov 23 07:48:05.393117 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 368/710] 10.222.0.48 () {60 vars in 1157 bytes} [Tue Nov 23 07:48:05 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:05.427773 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f51a852e-c6f5-4dce-89a0-fc1e0eae3f06 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:05.428817 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f51a852e-c6f5-4dce-89a0-fc1e0eae3f06 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:05.438262 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f51a852e-c6f5-4dce-89a0-fc1e0eae3f06 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:05.439035 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f51a852e-c6f5-4dce-89a0-fc1e0eae3f06 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:05.439940 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f51a852e-c6f5-4dce-89a0-fc1e0eae3f06 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:05.440591 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f51a852e-c6f5-4dce-89a0-fc1e0eae3f06 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:05.479354 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f51a852e-c6f5-4dce-89a0-fc1e0eae3f06 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055843 Nov 23 07:48:05.479989 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 343/711] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:48:05 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:48:06.256366 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ea5cf385-3308-4047-812a-dff357caef52 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:06.258133 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ea5cf385-3308-4047-812a-dff357caef52 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:06.266311 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea5cf385-3308-4047-812a-dff357caef52 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:06.267689 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea5cf385-3308-4047-812a-dff357caef52 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:06.268803 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea5cf385-3308-4047-812a-dff357caef52 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:06.269291 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea5cf385-3308-4047-812a-dff357caef52 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:06.359255 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ea5cf385-3308-4047-812a-dff357caef52 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 11454 microversion: 2.20 time: 0.107344 Nov 23 07:48:06.360372 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 369/712] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:06 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 11454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:48:06.499425 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-a00e0391-bcd9-4f6d-a2e3-40de891b20fa tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:06.518691 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-a00e0391-bcd9-4f6d-a2e3-40de891b20fa tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:06.545804 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a00e0391-bcd9-4f6d-a2e3-40de891b20fa tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:06.546909 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a00e0391-bcd9-4f6d-a2e3-40de891b20fa tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:06.559217 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a00e0391-bcd9-4f6d-a2e3-40de891b20fa tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:06.560530 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a00e0391-bcd9-4f6d-a2e3-40de891b20fa tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:06.701989 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-a00e0391-bcd9-4f6d-a2e3-40de891b20fa tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.211731 Nov 23 07:48:06.710092 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 344/713] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:48:06 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:48:07.376508 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-42a086be-3832-4295-9934-d63c5ded097c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:07.378294 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-42a086be-3832-4295-9934-d63c5ded097c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:07.386133 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-42a086be-3832-4295-9934-d63c5ded097c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:07.387000 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-42a086be-3832-4295-9934-d63c5ded097c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:07.387895 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-42a086be-3832-4295-9934-d63c5ded097c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:07.388550 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-42a086be-3832-4295-9934-d63c5ded097c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:07.510592 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f3b138c2-69c3-45e6-814c-4ee254407b74 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2135795904", "imageRef": "6895b3b6-16b9-4e43-bf1b-c19e73615ca8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41a8f465-c4c3-4408-a9dd-14556e78b966"}], "security_groups": [{"name": "tempest-securitygroup--853364726"}], "key_name": "tempest-keypair-528478556", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:07.531012 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-42a086be-3832-4295-9934-d63c5ded097c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 17744 microversion: 2.20 time: 0.161046 Nov 23 07:48:07.534370 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 370/714] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:07 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 17744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:07.716539 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e5c002c2-e886-4e2a-9384-de930cfbec2f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:07.717688 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e5c002c2-e886-4e2a-9384-de930cfbec2f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:07.725956 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e5c002c2-e886-4e2a-9384-de930cfbec2f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:07.726409 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e5c002c2-e886-4e2a-9384-de930cfbec2f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:07.727260 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e5c002c2-e886-4e2a-9384-de930cfbec2f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:07.727698 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e5c002c2-e886-4e2a-9384-de930cfbec2f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:07.781733 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e5c002c2-e886-4e2a-9384-de930cfbec2f tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069030 Nov 23 07:48:07.782797 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 371/715] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:48:07 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 07:48:07.796415 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-15facf5b-f058-4ec0-a16b-ec5142883bff tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:07.797035 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-15facf5b-f058-4ec0-a16b-ec5142883bff tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:07.807091 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-15facf5b-f058-4ec0-a16b-ec5142883bff tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:07.807543 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-15facf5b-f058-4ec0-a16b-ec5142883bff tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:07.808299 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-15facf5b-f058-4ec0-a16b-ec5142883bff tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:07.808722 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-15facf5b-f058-4ec0-a16b-ec5142883bff tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:07.817306 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.network.neutron [None req-f3b138c2-69c3-45e6-814c-4ee254407b74 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] validate_networks() for [('41a8f465-c4c3-4408-a9dd-14556e78b966', None, None, None, None, None)] {{(pid=122785) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:48:07.946588 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-15facf5b-f058-4ec0-a16b-ec5142883bff tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] HTTP exception thrown: Instance 842f1da9-1085-4946-b62b-9ae2c5ad009b is not attached to volume e096a1fe-8519-4b77-8d06-5e9183953b17 Nov 23 07:48:07.947483 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-15facf5b-f058-4ec0-a16b-ec5142883bff tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Returning 404 to user: Instance 842f1da9-1085-4946-b62b-9ae2c5ad009b is not attached to volume e096a1fe-8519-4b77-8d06-5e9183953b17 {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:48:07.948505 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-15facf5b-f058-4ec0-a16b-ec5142883bff tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "DELETE /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments/e096a1fe-8519-4b77-8d06-5e9183953b17" status: 404 len: 154 microversion: 2.1 time: 0.157396 Nov 23 07:48:07.953671 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 372/716] 10.222.0.48 () {58 vars in 1415 bytes} [Tue Nov 23 07:48:07 2021] DELETE /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b/os-volume_attachments/e096a1fe-8519-4b77-8d06-5e9183953b17 => generated 154 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:48:08.544919 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-f26e3195-e870-48dc-915e-7d30b4bfc3ca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:08.547318 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f26e3195-e870-48dc-915e-7d30b4bfc3ca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:08.559312 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f26e3195-e870-48dc-915e-7d30b4bfc3ca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:08.560615 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f26e3195-e870-48dc-915e-7d30b4bfc3ca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:08.562514 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f26e3195-e870-48dc-915e-7d30b4bfc3ca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:08.563714 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f26e3195-e870-48dc-915e-7d30b4bfc3ca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:08.677228 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-f26e3195-e870-48dc-915e-7d30b4bfc3ca tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 18827 microversion: 2.20 time: 0.135971 Nov 23 07:48:08.678423 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 373/717] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:08 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 18827 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:48:09.143565 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-f3b138c2-69c3-45e6-814c-4ee254407b74 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Flavor limits 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:48:09.144934 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-f3b138c2-69c3-45e6-814c-4ee254407b74 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Image limits 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:48:09.145823 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-f3b138c2-69c3-45e6-814c-4ee254407b74 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Flavor pref 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:48:09.146445 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-f3b138c2-69c3-45e6-814c-4ee254407b74 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Image pref 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:48:09.148042 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-f3b138c2-69c3-45e6-814c-4ee254407b74 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:48:09.162963 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f3b138c2-69c3-45e6-814c-4ee254407b74 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:09.163675 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f3b138c2-69c3-45e6-814c-4ee254407b74 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:09.164815 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f3b138c2-69c3-45e6-814c-4ee254407b74 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:09.165434 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f3b138c2-69c3-45e6-814c-4ee254407b74 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:09.179708 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6ae3373a-39e3-4acc-bc27-1c155f8bf641 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:09.180778 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6ae3373a-39e3-4acc-bc27-1c155f8bf641 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:09.189965 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6ae3373a-39e3-4acc-bc27-1c155f8bf641 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:09.191503 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6ae3373a-39e3-4acc-bc27-1c155f8bf641 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:09.193070 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6ae3373a-39e3-4acc-bc27-1c155f8bf641 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:09.193803 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6ae3373a-39e3-4acc-bc27-1c155f8bf641 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:09.200336 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-f3b138c2-69c3-45e6-814c-4ee254407b74 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Getting quotas for project bc7f91007a2a4b90b80701592589a131. Resources: {'instances', 'cores', 'ram'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:48:09.210175 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-f3b138c2-69c3-45e6-814c-4ee254407b74 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Getting quotas for user 6a88554481924707acaf2afd81d18793 and project bc7f91007a2a4b90b80701592589a131. Resources: {'instances', 'cores', 'ram'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:48:09.229209 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6ae3373a-39e3-4acc-bc27-1c155f8bf641 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Going to try to terminate instance {{(pid=122786) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:48:09.232528 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f3b138c2-69c3-45e6-814c-4ee254407b74 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Going to run 1 instances... {{(pid=122785) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:48:09.236211 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f3b138c2-69c3-45e6-814c-4ee254407b74 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6895b3b6-16b9-4e43-bf1b-c19e73615ca8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:48:09.326953 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f3b138c2-69c3-45e6-814c-4ee254407b74 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [c2ac9fa3-e449-4b6a-a8ed-dd65c969aed8] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 23 07:48:09.337469 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6ae3373a-39e3-4acc-bc27-1c155f8bf641 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "DELETE /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 204 len: 0 microversion: 2.1 time: 0.162137 Nov 23 07:48:09.341971 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 374/718] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:48:09 2021] DELETE /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 07:48:09.349009 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-5ecc39c8-1d20-4f19-a815-08826771039e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:09.350104 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-5ecc39c8-1d20-4f19-a815-08826771039e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:09.356915 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5ecc39c8-1d20-4f19-a815-08826771039e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:09.357479 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5ecc39c8-1d20-4f19-a815-08826771039e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:09.358443 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5ecc39c8-1d20-4f19-a815-08826771039e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:09.358973 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5ecc39c8-1d20-4f19-a815-08826771039e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:09.550221 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5ecc39c8-1d20-4f19-a815-08826771039e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:09.562029 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-5ecc39c8-1d20-4f19-a815-08826771039e tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1553 microversion: 2.1 time: 0.217221 Nov 23 07:48:09.562824 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 375/719] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:09 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:09.692866 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-99a288c2-4feb-45c5-9e4f-958d3882a1db tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:09.694378 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-99a288c2-4feb-45c5-9e4f-958d3882a1db tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:09.702766 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-99a288c2-4feb-45c5-9e4f-958d3882a1db tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:09.703222 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-99a288c2-4feb-45c5-9e4f-958d3882a1db tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:09.704055 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-99a288c2-4feb-45c5-9e4f-958d3882a1db tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:09.704484 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-99a288c2-4feb-45c5-9e4f-958d3882a1db tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:09.784122 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-99a288c2-4feb-45c5-9e4f-958d3882a1db tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 21165 microversion: 2.20 time: 0.096451 Nov 23 07:48:09.787714 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 376/720] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:09 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 21165 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:10.352516 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO oslo.messaging._drivers.impl_rabbit [None req-f3b138c2-69c3-45e6-814c-4ee254407b74 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [c2ac9fa3-e449-4b6a-a8ed-dd65c969aed8] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 42698. Nov 23 07:48:10.363680 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f3b138c2-69c3-45e6-814c-4ee254407b74 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.857626 Nov 23 07:48:10.364943 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 345/721] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Nov 23 07:48:07 2021] POST /compute/v2.1/servers => generated 401 bytes in 2860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 07:48:10.583277 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ee6b6031-5bdc-4564-9a20-a23081a395bf tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:10.584146 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-9342e40a-a98f-4d50-9858-c4bf5b09173c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:10.585149 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-9342e40a-a98f-4d50-9858-c4bf5b09173c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:10.585916 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ee6b6031-5bdc-4564-9a20-a23081a395bf tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:10.605149 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9342e40a-a98f-4d50-9858-c4bf5b09173c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:10.605951 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9342e40a-a98f-4d50-9858-c4bf5b09173c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:10.607751 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9342e40a-a98f-4d50-9858-c4bf5b09173c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:10.608592 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-9342e40a-a98f-4d50-9858-c4bf5b09173c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:10.692423 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ee6b6031-5bdc-4564-9a20-a23081a395bf tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:10.709072 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ee6b6031-5bdc-4564-9a20-a23081a395bf tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76" status: 200 len: 1237 microversion: 2.1 time: 0.333210 Nov 23 07:48:10.722007 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 377/722] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:10 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76 => generated 1237 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:10.799084 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-81afddbb-e5e8-4ddc-adf4-3f20ab636b31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:10.799986 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-81afddbb-e5e8-4ddc-adf4-3f20ab636b31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:10.809630 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-81afddbb-e5e8-4ddc-adf4-3f20ab636b31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:10.810540 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-81afddbb-e5e8-4ddc-adf4-3f20ab636b31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:10.821851 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-81afddbb-e5e8-4ddc-adf4-3f20ab636b31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:10.823929 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-81afddbb-e5e8-4ddc-adf4-3f20ab636b31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:10.911232 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-81afddbb-e5e8-4ddc-adf4-3f20ab636b31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 22981 microversion: 2.20 time: 0.116308 Nov 23 07:48:10.912775 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 378/723] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:10 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 22981 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:11.005427 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-9342e40a-a98f-4d50-9858-c4bf5b09173c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:11.018637 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-9342e40a-a98f-4d50-9858-c4bf5b09173c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1553 microversion: 2.1 time: 0.441182 Nov 23 07:48:11.025771 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 346/724] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:10 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1553 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:11.740439 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-3e37e615-2f28-48b5-9a3a-74c76c61e5d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:11.741975 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-3e37e615-2f28-48b5-9a3a-74c76c61e5d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:11.751926 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3e37e615-2f28-48b5-9a3a-74c76c61e5d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:11.753649 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3e37e615-2f28-48b5-9a3a-74c76c61e5d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:11.755160 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3e37e615-2f28-48b5-9a3a-74c76c61e5d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:11.755795 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3e37e615-2f28-48b5-9a3a-74c76c61e5d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:11.867151 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-3e37e615-2f28-48b5-9a3a-74c76c61e5d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:11.876537 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-3e37e615-2f28-48b5-9a3a-74c76c61e5d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76" status: 200 len: 1233 microversion: 2.1 time: 0.142689 Nov 23 07:48:11.877204 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 379/725] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:11 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76 => generated 1233 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:11.925040 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-29fb05e0-5c53-43ed-a574-e51b747fa50b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:11.926398 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-29fb05e0-5c53-43ed-a574-e51b747fa50b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:11.935959 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-29fb05e0-5c53-43ed-a574-e51b747fa50b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:11.937094 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-29fb05e0-5c53-43ed-a574-e51b747fa50b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:11.938963 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-29fb05e0-5c53-43ed-a574-e51b747fa50b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:11.939800 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-29fb05e0-5c53-43ed-a574-e51b747fa50b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:12.034375 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-29fb05e0-5c53-43ed-a574-e51b747fa50b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 23804 microversion: 2.20 time: 0.113247 Nov 23 07:48:12.037008 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 347/726] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:11 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 23804 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:12.056962 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-baa108a4-9370-4d3e-bf0d-aedc8fc54c04 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:12.059533 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-baa108a4-9370-4d3e-bf0d-aedc8fc54c04 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:12.075068 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-baa108a4-9370-4d3e-bf0d-aedc8fc54c04 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:12.076216 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-baa108a4-9370-4d3e-bf0d-aedc8fc54c04 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:12.078239 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-baa108a4-9370-4d3e-bf0d-aedc8fc54c04 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:12.079615 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-baa108a4-9370-4d3e-bf0d-aedc8fc54c04 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:12.432800 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-baa108a4-9370-4d3e-bf0d-aedc8fc54c04 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88be99113c1a48049e7cb4184f8394bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42cd8fcb71040c394c2fa2ed9324ae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:12.463009 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-baa108a4-9370-4d3e-bf0d-aedc8fc54c04 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 200 len: 1553 microversion: 2.1 time: 0.424394 Nov 23 07:48:12.516877 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 380/727] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:12 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 1553 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:12.580848 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-1d4c04b0-2ee1-4b82-b11e-0193da41cd5d req-3aaa16c9-f5b3-477c-9ff5-4af571d2352c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "842f1da9-1085-4946-b62b-9ae2c5ad009b", "name": "network-vif-deleted", "tag": "46440f82-0a6b-4d97-82a5-b146d1263ea9"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:12.585760 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:48:12.585760 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:48:12.606817 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-1d4c04b0-2ee1-4b82-b11e-0193da41cd5d req-3aaa16c9-f5b3-477c-9ff5-4af571d2352c service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:12.613321 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-1d4c04b0-2ee1-4b82-b11e-0193da41cd5d req-3aaa16c9-f5b3-477c-9ff5-4af571d2352c service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:12.650748 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-1d4c04b0-2ee1-4b82-b11e-0193da41cd5d req-3aaa16c9-f5b3-477c-9ff5-4af571d2352c service nova] Creating event network-vif-deleted:46440f82-0a6b-4d97-82a5-b146d1263ea9 for instance 842f1da9-1085-4946-b62b-9ae2c5ad009b on hv-cinder-80403 Nov 23 07:48:12.657276 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-1d4c04b0-2ee1-4b82-b11e-0193da41cd5d req-3aaa16c9-f5b3-477c-9ff5-4af571d2352c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081250 Nov 23 07:48:12.658696 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 348/728] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:48:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:48:12.899566 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-35797433-928d-4dd9-b67a-20408a51889c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:12.900959 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-35797433-928d-4dd9-b67a-20408a51889c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:12.908223 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-35797433-928d-4dd9-b67a-20408a51889c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:12.909116 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-35797433-928d-4dd9-b67a-20408a51889c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:12.911187 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-35797433-928d-4dd9-b67a-20408a51889c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:12.911852 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-35797433-928d-4dd9-b67a-20408a51889c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:13.012190 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-35797433-928d-4dd9-b67a-20408a51889c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:13.020679 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-35797433-928d-4dd9-b67a-20408a51889c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76" status: 200 len: 1295 microversion: 2.1 time: 0.125854 Nov 23 07:48:13.021822 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 381/729] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:12 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76 => generated 1295 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:13.049158 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-a819694c-7efa-4914-8f4f-802cc8df9459 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:13.051764 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-a819694c-7efa-4914-8f4f-802cc8df9459 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:13.064071 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a819694c-7efa-4914-8f4f-802cc8df9459 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:13.065356 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a819694c-7efa-4914-8f4f-802cc8df9459 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:13.067945 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a819694c-7efa-4914-8f4f-802cc8df9459 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:13.069480 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a819694c-7efa-4914-8f4f-802cc8df9459 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:13.173723 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-a819694c-7efa-4914-8f4f-802cc8df9459 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 25479 microversion: 2.20 time: 0.128958 Nov 23 07:48:13.183762 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 349/730] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:13 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 25479 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:13.499233 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6024460d-e5b8-42c2-981f-2f9b07faa60c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:13.501747 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6024460d-e5b8-42c2-981f-2f9b07faa60c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] [instance: 842f1da9-1085-4946-b62b-9ae2c5ad009b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:13.518415 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6024460d-e5b8-42c2-981f-2f9b07faa60c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:13.519584 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6024460d-e5b8-42c2-981f-2f9b07faa60c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:13.521098 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6024460d-e5b8-42c2-981f-2f9b07faa60c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:13.522017 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6024460d-e5b8-42c2-981f-2f9b07faa60c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:13.554460 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-6024460d-e5b8-42c2-981f-2f9b07faa60c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] HTTP exception thrown: Instance 842f1da9-1085-4946-b62b-9ae2c5ad009b could not be found. Nov 23 07:48:13.555568 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6024460d-e5b8-42c2-981f-2f9b07faa60c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Returning 404 to user: Instance 842f1da9-1085-4946-b62b-9ae2c5ad009b could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:48:13.557626 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6024460d-e5b8-42c2-981f-2f9b07faa60c tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b" status: 404 len: 111 microversion: 2.1 time: 0.068966 Nov 23 07:48:13.562768 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 382/731] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:13 2021] GET /compute/v2.1/servers/842f1da9-1085-4946-b62b-9ae2c5ad009b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:48:13.573214 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-928b5007-1412-4688-a1d5-fa285a79e1c3 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] Calling method '.version_select at 0x7f051402f0d0>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:13.611193 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-928b5007-1412-4688-a1d5-fa285a79e1c3 tempest-TestMinimumBasicScenario-318383764 tempest-TestMinimumBasicScenario-318383764-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-991011702" status: 202 len: 0 microversion: 2.1 time: 0.046469 Nov 23 07:48:13.617398 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 350/732] 10.222.0.48 () {58 vars in 1268 bytes} [Tue Nov 23 07:48:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-991011702 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:14.050129 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d7a475d3-f5f6-4944-808a-9b496e8565aa tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:14.052680 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d7a475d3-f5f6-4944-808a-9b496e8565aa tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:14.064320 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d7a475d3-f5f6-4944-808a-9b496e8565aa tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:14.065909 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d7a475d3-f5f6-4944-808a-9b496e8565aa tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:14.067998 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d7a475d3-f5f6-4944-808a-9b496e8565aa tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:14.069363 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d7a475d3-f5f6-4944-808a-9b496e8565aa tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:14.187869 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5a1cdd88-26e2-4137-9845-3d1bbaf92455 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:14.189695 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5a1cdd88-26e2-4137-9845-3d1bbaf92455 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:14.218267 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5a1cdd88-26e2-4137-9845-3d1bbaf92455 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:14.219826 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5a1cdd88-26e2-4137-9845-3d1bbaf92455 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:14.221510 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5a1cdd88-26e2-4137-9845-3d1bbaf92455 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:14.243171 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5a1cdd88-26e2-4137-9845-3d1bbaf92455 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:14.373845 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5a1cdd88-26e2-4137-9845-3d1bbaf92455 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 26927 microversion: 2.20 time: 0.190166 Nov 23 07:48:14.376468 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 351/733] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:14 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 26927 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:14.407503 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d7a475d3-f5f6-4944-808a-9b496e8565aa tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:14.420205 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d7a475d3-f5f6-4944-808a-9b496e8565aa tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76" status: 200 len: 1362 microversion: 2.1 time: 0.377020 Nov 23 07:48:14.427231 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 383/734] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:14 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76 => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:15.389033 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-4c7192eb-052f-4ca2-ab9d-a173574f8d94 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:15.390376 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-4c7192eb-052f-4ca2-ab9d-a173574f8d94 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:15.407407 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4c7192eb-052f-4ca2-ab9d-a173574f8d94 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:15.414352 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4c7192eb-052f-4ca2-ab9d-a173574f8d94 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:15.419617 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4c7192eb-052f-4ca2-ab9d-a173574f8d94 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:15.420684 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4c7192eb-052f-4ca2-ab9d-a173574f8d94 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:15.443315 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-36c23843-61d7-4a47-a488-b986106c0a01 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:15.444146 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-36c23843-61d7-4a47-a488-b986106c0a01 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:15.454151 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-36c23843-61d7-4a47-a488-b986106c0a01 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:15.454604 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-36c23843-61d7-4a47-a488-b986106c0a01 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:15.455417 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-36c23843-61d7-4a47-a488-b986106c0a01 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:15.455853 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-36c23843-61d7-4a47-a488-b986106c0a01 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:15.615194 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-4c7192eb-052f-4ca2-ab9d-a173574f8d94 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 27754 microversion: 2.20 time: 0.229909 Nov 23 07:48:15.622571 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 352/735] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:15 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 27754 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:48:15.919011 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-be659b2d-de42-4e6c-a00b-87fb8202582a req-f1851212-19e9-4898-a7c9-9098c3a3353c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65836c81-3d98-4338-a51d-aa3bb0ef7b76", "tag": "57edcc25-5f03-4d06-8e19-80459dbc84fb"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:15.921472 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:48:15.921472 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:48:15.943013 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-be659b2d-de42-4e6c-a00b-87fb8202582a req-f1851212-19e9-4898-a7c9-9098c3a3353c service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:15.943731 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-be659b2d-de42-4e6c-a00b-87fb8202582a req-f1851212-19e9-4898-a7c9-9098c3a3353c service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:15.958172 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-be659b2d-de42-4e6c-a00b-87fb8202582a req-f1851212-19e9-4898-a7c9-9098c3a3353c service nova] Creating event network-changed:57edcc25-5f03-4d06-8e19-80459dbc84fb for instance 65836c81-3d98-4338-a51d-aa3bb0ef7b76 on hv-cinder-80403 Nov 23 07:48:15.964125 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-be659b2d-de42-4e6c-a00b-87fb8202582a req-f1851212-19e9-4898-a7c9-9098c3a3353c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064054 Nov 23 07:48:15.965521 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 353/736] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:48:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:48:16.427323 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-36c23843-61d7-4a47-a488-b986106c0a01 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:16.447889 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-36c23843-61d7-4a47-a488-b986106c0a01 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76" status: 200 len: 1362 microversion: 2.1 time: 1.007866 Nov 23 07:48:16.467772 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 384/737] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:15 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76 => generated 1362 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:17.100369 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-0c7bd472-551c-4a89-8f38-a2c98137783e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:17.102033 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-0c7bd472-551c-4a89-8f38-a2c98137783e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:17.113752 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0c7bd472-551c-4a89-8f38-a2c98137783e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:17.114198 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0c7bd472-551c-4a89-8f38-a2c98137783e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:17.115023 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0c7bd472-551c-4a89-8f38-a2c98137783e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:17.115460 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0c7bd472-551c-4a89-8f38-a2c98137783e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:17.270607 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-0c7bd472-551c-4a89-8f38-a2c98137783e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 28193 microversion: 2.20 time: 0.643275 Nov 23 07:48:17.273863 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 354/738] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:16 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 28193 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:17.484727 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d73c0eb0-b456-404b-8d51-767281f1fab8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:17.486829 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d73c0eb0-b456-404b-8d51-767281f1fab8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:17.500650 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d73c0eb0-b456-404b-8d51-767281f1fab8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:17.502490 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d73c0eb0-b456-404b-8d51-767281f1fab8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:17.504148 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d73c0eb0-b456-404b-8d51-767281f1fab8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:17.505871 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d73c0eb0-b456-404b-8d51-767281f1fab8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:17.833441 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d73c0eb0-b456-404b-8d51-767281f1fab8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:17.861665 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d73c0eb0-b456-404b-8d51-767281f1fab8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76" status: 200 len: 1362 microversion: 2.1 time: 0.383366 Nov 23 07:48:17.877989 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 385/739] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:17 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76 => generated 1362 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:18.292444 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ba68da77-dec7-4b20-84c0-0d31acb54a7f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:18.294417 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ba68da77-dec7-4b20-84c0-0d31acb54a7f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:18.332318 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ba68da77-dec7-4b20-84c0-0d31acb54a7f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:18.333561 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ba68da77-dec7-4b20-84c0-0d31acb54a7f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:18.341073 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ba68da77-dec7-4b20-84c0-0d31acb54a7f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:18.342121 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ba68da77-dec7-4b20-84c0-0d31acb54a7f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:18.455578 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ba68da77-dec7-4b20-84c0-0d31acb54a7f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 28193 microversion: 2.20 time: 0.171559 Nov 23 07:48:18.457173 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 355/740] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:18 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 28193 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:18.895873 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8408bac7-1959-4d71-9123-9da0724d2f22 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:18.898680 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8408bac7-1959-4d71-9123-9da0724d2f22 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:18.959409 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8408bac7-1959-4d71-9123-9da0724d2f22 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:18.988840 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8408bac7-1959-4d71-9123-9da0724d2f22 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:18.989634 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8408bac7-1959-4d71-9123-9da0724d2f22 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:18.994301 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8408bac7-1959-4d71-9123-9da0724d2f22 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:19.466428 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-8408bac7-1959-4d71-9123-9da0724d2f22 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:19.475184 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-858e1fb2-70d9-48f8-830b-43e8df54cb80 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:19.478077 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-858e1fb2-70d9-48f8-830b-43e8df54cb80 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:19.488757 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-8408bac7-1959-4d71-9123-9da0724d2f22 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76" status: 200 len: 1362 microversion: 2.1 time: 0.598060 Nov 23 07:48:19.493751 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 386/741] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:18 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76 => generated 1362 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:19.495623 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-858e1fb2-70d9-48f8-830b-43e8df54cb80 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:19.496296 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-858e1fb2-70d9-48f8-830b-43e8df54cb80 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:19.497290 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-858e1fb2-70d9-48f8-830b-43e8df54cb80 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:19.498016 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-858e1fb2-70d9-48f8-830b-43e8df54cb80 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:19.603849 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-858e1fb2-70d9-48f8-830b-43e8df54cb80 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 28484 microversion: 2.20 time: 0.135561 Nov 23 07:48:19.604839 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 356/742] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:19 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 28484 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:20.510487 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-3a201c13-e92f-49fc-ba4c-f0b5899f1315 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:20.522456 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-3a201c13-e92f-49fc-ba4c-f0b5899f1315 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:20.539752 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3a201c13-e92f-49fc-ba4c-f0b5899f1315 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:20.540199 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3a201c13-e92f-49fc-ba4c-f0b5899f1315 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:20.543226 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3a201c13-e92f-49fc-ba4c-f0b5899f1315 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:20.547129 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3a201c13-e92f-49fc-ba4c-f0b5899f1315 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:20.617299 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-445472e4-fc7c-4132-9cc0-76c5ecb35662 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:20.623454 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-445472e4-fc7c-4132-9cc0-76c5ecb35662 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:20.651233 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-445472e4-fc7c-4132-9cc0-76c5ecb35662 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:20.652551 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-445472e4-fc7c-4132-9cc0-76c5ecb35662 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:20.654309 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-445472e4-fc7c-4132-9cc0-76c5ecb35662 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:20.656019 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-445472e4-fc7c-4132-9cc0-76c5ecb35662 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:20.784385 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-445472e4-fc7c-4132-9cc0-76c5ecb35662 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 28652 microversion: 2.20 time: 0.171664 Nov 23 07:48:20.786075 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 357/743] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:20 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 28652 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:21.306461 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-3a201c13-e92f-49fc-ba4c-f0b5899f1315 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:21.318227 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-3a201c13-e92f-49fc-ba4c-f0b5899f1315 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76" status: 200 len: 1362 microversion: 2.1 time: 0.810000 Nov 23 07:48:21.321300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 387/744] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:20 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76 => generated 1362 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:21.800365 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c67057ca-825a-4c87-a980-026e3c8612b7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:21.802158 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c67057ca-825a-4c87-a980-026e3c8612b7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:21.835349 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c67057ca-825a-4c87-a980-026e3c8612b7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:21.836383 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c67057ca-825a-4c87-a980-026e3c8612b7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:21.839624 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c67057ca-825a-4c87-a980-026e3c8612b7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:21.840905 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c67057ca-825a-4c87-a980-026e3c8612b7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:21.966237 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c67057ca-825a-4c87-a980-026e3c8612b7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 28652 microversion: 2.20 time: 0.171944 Nov 23 07:48:21.967434 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 358/745] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:21 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 28652 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:22.350204 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d790c38d-5b23-4b8b-b367-3dd6d85ab4d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:22.357547 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d790c38d-5b23-4b8b-b367-3dd6d85ab4d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:22.373996 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d790c38d-5b23-4b8b-b367-3dd6d85ab4d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:22.375179 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d790c38d-5b23-4b8b-b367-3dd6d85ab4d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:22.376247 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d790c38d-5b23-4b8b-b367-3dd6d85ab4d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:22.376896 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d790c38d-5b23-4b8b-b367-3dd6d85ab4d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:22.815733 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d790c38d-5b23-4b8b-b367-3dd6d85ab4d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:22.851793 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d790c38d-5b23-4b8b-b367-3dd6d85ab4d1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76" status: 200 len: 1362 microversion: 2.1 time: 0.516826 Nov 23 07:48:22.853134 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 388/746] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:22 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76 => generated 1362 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:22.982253 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-2e726071-aa88-49c5-a8b6-1e912ae9ee31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:22.984032 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-2e726071-aa88-49c5-a8b6-1e912ae9ee31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:23.003434 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2e726071-aa88-49c5-a8b6-1e912ae9ee31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:23.003884 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2e726071-aa88-49c5-a8b6-1e912ae9ee31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:23.004701 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2e726071-aa88-49c5-a8b6-1e912ae9ee31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:23.005136 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2e726071-aa88-49c5-a8b6-1e912ae9ee31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:23.066931 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-19c110bf-ebeb-45cf-8616-39d202eaa3a2 req-ef394f53-e3d0-43fa-b36c-4229eeee2c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65836c81-3d98-4338-a51d-aa3bb0ef7b76", "name": "network-vif-plugged", "status": "completed", "tag": "57edcc25-5f03-4d06-8e19-80459dbc84fb"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:23.069372 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:48:23.069372 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:48:23.098724 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-19c110bf-ebeb-45cf-8616-39d202eaa3a2 req-ef394f53-e3d0-43fa-b36c-4229eeee2c99 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:23.099173 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-19c110bf-ebeb-45cf-8616-39d202eaa3a2 req-ef394f53-e3d0-43fa-b36c-4229eeee2c99 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:23.131210 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-19c110bf-ebeb-45cf-8616-39d202eaa3a2 req-ef394f53-e3d0-43fa-b36c-4229eeee2c99 service nova] Creating event network-vif-plugged:57edcc25-5f03-4d06-8e19-80459dbc84fb for instance 65836c81-3d98-4338-a51d-aa3bb0ef7b76 on hv-cinder-80403 Nov 23 07:48:23.131539 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-2e726071-aa88-49c5-a8b6-1e912ae9ee31 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 28652 microversion: 2.20 time: 0.148219 Nov 23 07:48:23.132855 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 359/747] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:22 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 28652 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:48:23.142830 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-19c110bf-ebeb-45cf-8616-39d202eaa3a2 req-ef394f53-e3d0-43fa-b36c-4229eeee2c99 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101331 Nov 23 07:48:23.144241 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 389/748] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:48:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:48:23.873746 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-2067f307-3ae8-4f88-9500-ec34295ed803 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:23.875129 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-2067f307-3ae8-4f88-9500-ec34295ed803 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:23.896976 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2067f307-3ae8-4f88-9500-ec34295ed803 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:23.897799 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2067f307-3ae8-4f88-9500-ec34295ed803 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:23.899250 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2067f307-3ae8-4f88-9500-ec34295ed803 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:23.900286 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2067f307-3ae8-4f88-9500-ec34295ed803 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:24.111186 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-82c638b5-2030-40d3-b291-3cbe60158464 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Action: 'create', calling method: .version_select at 0x7f05146f63a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1953697943"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:24.129117 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-82c638b5-2030-40d3-b291-3cbe60158464 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Getting quotas for project 2d805701d3af40f59df0733595904769. Resources: {'key_pairs'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:48:24.135424 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-82c638b5-2030-40d3-b291-3cbe60158464 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Getting quotas for user 49e051a1a3934a12a2485cf6a2504932 and project 2d805701d3af40f59df0733595904769. Resources: {'key_pairs'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:48:24.192453 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-2067f307-3ae8-4f88-9500-ec34295ed803 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:24.206043 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-2067f307-3ae8-4f88-9500-ec34295ed803 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76" status: 200 len: 1362 microversion: 2.1 time: 0.338195 Nov 23 07:48:24.207764 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 360/749] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:23 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76 => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:48:24.216793 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-915f78d8-c7d9-45b4-ad7f-2f93b9a13d9c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:24.218950 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-915f78d8-c7d9-45b4-ad7f-2f93b9a13d9c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:24.230826 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-915f78d8-c7d9-45b4-ad7f-2f93b9a13d9c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:24.232012 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-915f78d8-c7d9-45b4-ad7f-2f93b9a13d9c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:24.234807 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-915f78d8-c7d9-45b4-ad7f-2f93b9a13d9c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:24.235923 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-915f78d8-c7d9-45b4-ad7f-2f93b9a13d9c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:24.348492 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-915f78d8-c7d9-45b4-ad7f-2f93b9a13d9c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 28652 microversion: 2.20 time: 0.138456 Nov 23 07:48:24.359087 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 361/750] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:24 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 28652 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:24.548934 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-82c638b5-2030-40d3-b291-3cbe60158464 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Getting quotas for project 2d805701d3af40f59df0733595904769. Resources: {'key_pairs'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:48:24.558192 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-82c638b5-2030-40d3-b291-3cbe60158464 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Getting quotas for user 49e051a1a3934a12a2485cf6a2504932 and project 2d805701d3af40f59df0733595904769. Resources: {'key_pairs'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:48:24.596082 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-82c638b5-2030-40d3-b291-3cbe60158464 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.627470 Nov 23 07:48:24.597251 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 390/751] 10.222.0.48 () {60 vars in 1157 bytes} [Tue Nov 23 07:48:23 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:25.228416 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ea011582-f8c1-44c3-97bf-5d7f13cf96fc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:25.229274 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ea011582-f8c1-44c3-97bf-5d7f13cf96fc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:25.246436 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ea011582-f8c1-44c3-97bf-5d7f13cf96fc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:25.247324 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ea011582-f8c1-44c3-97bf-5d7f13cf96fc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:25.248436 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ea011582-f8c1-44c3-97bf-5d7f13cf96fc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:25.249121 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ea011582-f8c1-44c3-97bf-5d7f13cf96fc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:25.374847 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-096cd716-767c-4ad3-a104-6da7fb28ac42 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:25.377249 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-096cd716-767c-4ad3-a104-6da7fb28ac42 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:25.397075 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-096cd716-767c-4ad3-a104-6da7fb28ac42 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:25.398127 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-096cd716-767c-4ad3-a104-6da7fb28ac42 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:25.402252 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-096cd716-767c-4ad3-a104-6da7fb28ac42 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:25.403793 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-096cd716-767c-4ad3-a104-6da7fb28ac42 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:25.504622 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-096cd716-767c-4ad3-a104-6da7fb28ac42 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 30247 microversion: 2.20 time: 0.134511 Nov 23 07:48:25.506158 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 391/752] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:25 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 30247 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:48:25.517956 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ea011582-f8c1-44c3-97bf-5d7f13cf96fc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:25.526743 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ea011582-f8c1-44c3-97bf-5d7f13cf96fc tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76" status: 200 len: 1549 microversion: 2.1 time: 0.303100 Nov 23 07:48:25.540098 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 362/753] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:25 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76 => generated 1549 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:48:25.546647 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4d090cb5-c053-4059-bfe8-5dcf46a3c7fe tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:25.547884 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4d090cb5-c053-4059-bfe8-5dcf46a3c7fe tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:25.557090 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4d090cb5-c053-4059-bfe8-5dcf46a3c7fe tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:25.558125 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4d090cb5-c053-4059-bfe8-5dcf46a3c7fe tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:25.559229 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4d090cb5-c053-4059-bfe8-5dcf46a3c7fe tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:25.559919 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4d090cb5-c053-4059-bfe8-5dcf46a3c7fe tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:25.764516 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4d090cb5-c053-4059-bfe8-5dcf46a3c7fe tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.222575 Nov 23 07:48:25.765294 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 392/754] 10.222.0.48 () {58 vars in 1274 bytes} [Tue Nov 23 07:48:25 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-interface => generated 285 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:48:26.520409 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ae120dc1-fd7f-435a-826b-c2ff874c150a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:26.521367 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ae120dc1-fd7f-435a-826b-c2ff874c150a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:26.534510 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ae120dc1-fd7f-435a-826b-c2ff874c150a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:26.536831 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ae120dc1-fd7f-435a-826b-c2ff874c150a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:26.539656 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ae120dc1-fd7f-435a-826b-c2ff874c150a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:26.540946 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ae120dc1-fd7f-435a-826b-c2ff874c150a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:26.805496 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ae120dc1-fd7f-435a-826b-c2ff874c150a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 32669 microversion: 2.20 time: 0.288346 Nov 23 07:48:26.807955 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 363/755] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:26 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 32669 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:48:27.826575 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1e81dced-aec4-4f63-8067-5ca0a10150f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:27.831122 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1e81dced-aec4-4f63-8067-5ca0a10150f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:27.850358 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e81dced-aec4-4f63-8067-5ca0a10150f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:27.851132 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e81dced-aec4-4f63-8067-5ca0a10150f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:27.852541 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e81dced-aec4-4f63-8067-5ca0a10150f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:27.853163 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e81dced-aec4-4f63-8067-5ca0a10150f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:27.963571 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1e81dced-aec4-4f63-8067-5ca0a10150f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 33662 microversion: 2.20 time: 0.143952 Nov 23 07:48:27.965646 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 393/756] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:27 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 33662 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:48:28.554535 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5c7e4da7-9f9d-4989-a200-7ea9d11dbb6c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:28.555839 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5c7e4da7-9f9d-4989-a200-7ea9d11dbb6c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:28.569967 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-333bfb78-bc81-4f42-bc49-dca7dc8ffa61 req-82ea163f-0d59-42c1-8227-cf9e807346ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65836c81-3d98-4338-a51d-aa3bb0ef7b76", "tag": "57edcc25-5f03-4d06-8e19-80459dbc84fb"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:28.571669 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:48:28.571669 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:48:28.574409 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5c7e4da7-9f9d-4989-a200-7ea9d11dbb6c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:28.575641 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5c7e4da7-9f9d-4989-a200-7ea9d11dbb6c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:28.578049 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5c7e4da7-9f9d-4989-a200-7ea9d11dbb6c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:28.579378 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5c7e4da7-9f9d-4989-a200-7ea9d11dbb6c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:28.589086 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-333bfb78-bc81-4f42-bc49-dca7dc8ffa61 req-82ea163f-0d59-42c1-8227-cf9e807346ea service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:28.589641 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-333bfb78-bc81-4f42-bc49-dca7dc8ffa61 req-82ea163f-0d59-42c1-8227-cf9e807346ea service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:28.624702 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-333bfb78-bc81-4f42-bc49-dca7dc8ffa61 req-82ea163f-0d59-42c1-8227-cf9e807346ea service nova] Creating event network-changed:57edcc25-5f03-4d06-8e19-80459dbc84fb for instance 65836c81-3d98-4338-a51d-aa3bb0ef7b76 on hv-cinder-80403 Nov 23 07:48:28.646909 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-333bfb78-bc81-4f42-bc49-dca7dc8ffa61 req-82ea163f-0d59-42c1-8227-cf9e807346ea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084386 Nov 23 07:48:28.649248 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 394/757] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:48:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:48:28.685766 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5c7e4da7-9f9d-4989-a200-7ea9d11dbb6c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 14 microversion: 2.1 time: 0.135497 Nov 23 07:48:28.688021 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 364/758] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:28 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:48:28.977480 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-36235100-c147-438b-acc8-182189603d3e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:28.979563 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-36235100-c147-438b-acc8-182189603d3e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:28.990513 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-36235100-c147-438b-acc8-182189603d3e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:28.991232 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-36235100-c147-438b-acc8-182189603d3e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:28.992427 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-36235100-c147-438b-acc8-182189603d3e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:28.993045 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-36235100-c147-438b-acc8-182189603d3e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:29.098039 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-36235100-c147-438b-acc8-182189603d3e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 34861 microversion: 2.20 time: 0.124839 Nov 23 07:48:29.103319 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 395/759] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:28 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 34861 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:48:29.704847 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-44b3a5a3-c46a-456f-bfb4-b579bf9cfab2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:29.708523 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-44b3a5a3-c46a-456f-bfb4-b579bf9cfab2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:29.722715 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-44b3a5a3-c46a-456f-bfb4-b579bf9cfab2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:29.728878 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-44b3a5a3-c46a-456f-bfb4-b579bf9cfab2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:29.733785 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-44b3a5a3-c46a-456f-bfb4-b579bf9cfab2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:29.737607 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-44b3a5a3-c46a-456f-bfb4-b579bf9cfab2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:29.851570 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-44b3a5a3-c46a-456f-bfb4-b579bf9cfab2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 14 microversion: 2.1 time: 0.154507 Nov 23 07:48:29.854592 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 365/760] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:29 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:48:30.111153 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-dd2c2212-121e-4403-ab56-6fae66f54b34 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:30.112344 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-dd2c2212-121e-4403-ab56-6fae66f54b34 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:30.119781 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-dd2c2212-121e-4403-ab56-6fae66f54b34 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:30.120221 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-dd2c2212-121e-4403-ab56-6fae66f54b34 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:30.121108 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-dd2c2212-121e-4403-ab56-6fae66f54b34 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:30.121646 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-dd2c2212-121e-4403-ab56-6fae66f54b34 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:30.207098 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-dd2c2212-121e-4403-ab56-6fae66f54b34 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 35951 microversion: 2.20 time: 0.099902 Nov 23 07:48:30.207912 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 396/761] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:30 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 35951 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:30.866351 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-60548b9f-1bd8-4017-acb7-384632bdd04b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:30.867388 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-60548b9f-1bd8-4017-acb7-384632bdd04b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:30.874665 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-60548b9f-1bd8-4017-acb7-384632bdd04b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:30.875458 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-60548b9f-1bd8-4017-acb7-384632bdd04b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:30.876640 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-60548b9f-1bd8-4017-acb7-384632bdd04b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:30.877078 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-60548b9f-1bd8-4017-acb7-384632bdd04b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:30.950349 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-60548b9f-1bd8-4017-acb7-384632bdd04b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 14 microversion: 2.1 time: 0.088210 Nov 23 07:48:30.955972 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 366/762] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:30 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 07:48:31.233814 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1e20c180-089f-46f7-8ce9-bbe36660cc4f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:31.235031 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1e20c180-089f-46f7-8ce9-bbe36660cc4f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:31.248708 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e20c180-089f-46f7-8ce9-bbe36660cc4f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:31.249320 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e20c180-089f-46f7-8ce9-bbe36660cc4f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:31.250415 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e20c180-089f-46f7-8ce9-bbe36660cc4f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:31.250881 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e20c180-089f-46f7-8ce9-bbe36660cc4f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:31.348161 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1e20c180-089f-46f7-8ce9-bbe36660cc4f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 37401 microversion: 2.20 time: 0.128445 Nov 23 07:48:31.348916 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 397/763] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:31 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 37401 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:31.964237 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-42eab837-cbd0-4bdc-b8b1-8f82f9030804 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:31.965609 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-42eab837-cbd0-4bdc-b8b1-8f82f9030804 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:31.972721 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-42eab837-cbd0-4bdc-b8b1-8f82f9030804 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:31.973192 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-42eab837-cbd0-4bdc-b8b1-8f82f9030804 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:31.973990 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-42eab837-cbd0-4bdc-b8b1-8f82f9030804 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:31.974420 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-42eab837-cbd0-4bdc-b8b1-8f82f9030804 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:32.042756 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-42eab837-cbd0-4bdc-b8b1-8f82f9030804 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 14 microversion: 2.1 time: 0.082142 Nov 23 07:48:32.043919 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 367/764] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:31 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:48:32.362877 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-69b58053-930f-4926-920b-558888fdd7b9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:32.364273 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-69b58053-930f-4926-920b-558888fdd7b9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:32.372370 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-69b58053-930f-4926-920b-558888fdd7b9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:32.372889 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-69b58053-930f-4926-920b-558888fdd7b9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:32.373730 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-69b58053-930f-4926-920b-558888fdd7b9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:32.374168 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-69b58053-930f-4926-920b-558888fdd7b9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:32.455240 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-69b58053-930f-4926-920b-558888fdd7b9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 38187 microversion: 2.20 time: 0.097589 Nov 23 07:48:32.455959 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 398/765] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:32 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 38187 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:33.067870 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c8d0ab9e-80cd-407e-834f-d68ad18a0415 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:33.071068 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c8d0ab9e-80cd-407e-834f-d68ad18a0415 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:33.085321 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c8d0ab9e-80cd-407e-834f-d68ad18a0415 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:33.086502 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c8d0ab9e-80cd-407e-834f-d68ad18a0415 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:33.088336 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c8d0ab9e-80cd-407e-834f-d68ad18a0415 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:33.089384 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c8d0ab9e-80cd-407e-834f-d68ad18a0415 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:33.178739 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c8d0ab9e-80cd-407e-834f-d68ad18a0415 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 14 microversion: 2.1 time: 0.124058 Nov 23 07:48:33.179715 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 368/766] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:33 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:48:33.470029 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8483266f-f177-45ed-b0c8-72edb32a1049 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:33.471919 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8483266f-f177-45ed-b0c8-72edb32a1049 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:33.488669 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8483266f-f177-45ed-b0c8-72edb32a1049 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:33.490054 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8483266f-f177-45ed-b0c8-72edb32a1049 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:33.492492 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8483266f-f177-45ed-b0c8-72edb32a1049 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:33.493503 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8483266f-f177-45ed-b0c8-72edb32a1049 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:33.584971 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-8483266f-f177-45ed-b0c8-72edb32a1049 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 38187 microversion: 2.20 time: 0.120143 Nov 23 07:48:33.587100 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 399/767] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:33 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 38187 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:48:34.198501 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-596e0d6b-5bf0-408e-b0bf-cbd6b8493b48 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:34.208662 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-596e0d6b-5bf0-408e-b0bf-cbd6b8493b48 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:34.217221 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-596e0d6b-5bf0-408e-b0bf-cbd6b8493b48 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:34.217680 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-596e0d6b-5bf0-408e-b0bf-cbd6b8493b48 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:34.218581 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-596e0d6b-5bf0-408e-b0bf-cbd6b8493b48 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:34.219027 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-596e0d6b-5bf0-408e-b0bf-cbd6b8493b48 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:34.302838 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-596e0d6b-5bf0-408e-b0bf-cbd6b8493b48 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 14 microversion: 2.1 time: 0.111770 Nov 23 07:48:34.304277 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 369/768] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:34 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:48:34.602966 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b858718c-8adb-43bd-96f4-8e6a06563882 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:34.604014 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-b858718c-8adb-43bd-96f4-8e6a06563882 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:34.631023 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b858718c-8adb-43bd-96f4-8e6a06563882 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:34.632419 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b858718c-8adb-43bd-96f4-8e6a06563882 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:34.634550 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b858718c-8adb-43bd-96f4-8e6a06563882 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:34.635387 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b858718c-8adb-43bd-96f4-8e6a06563882 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:34.742409 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b858718c-8adb-43bd-96f4-8e6a06563882 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 38187 microversion: 2.20 time: 0.147055 Nov 23 07:48:34.746773 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 400/769] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:34 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 38187 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:35.321526 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-0ce1738d-9d23-4799-93f7-c322012cd4b7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:35.324527 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-0ce1738d-9d23-4799-93f7-c322012cd4b7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:35.339751 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0ce1738d-9d23-4799-93f7-c322012cd4b7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:35.340491 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0ce1738d-9d23-4799-93f7-c322012cd4b7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:35.342339 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0ce1738d-9d23-4799-93f7-c322012cd4b7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:35.343775 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0ce1738d-9d23-4799-93f7-c322012cd4b7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:35.442351 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-0ce1738d-9d23-4799-93f7-c322012cd4b7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 14 microversion: 2.1 time: 0.130784 Nov 23 07:48:35.443363 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 370/770] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:35 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 07:48:35.760655 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-f4e482c7-87bc-4694-b4be-45137a5688fb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:35.761882 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f4e482c7-87bc-4694-b4be-45137a5688fb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:35.781228 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f4e482c7-87bc-4694-b4be-45137a5688fb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:35.782079 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f4e482c7-87bc-4694-b4be-45137a5688fb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:35.783579 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f4e482c7-87bc-4694-b4be-45137a5688fb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:35.784931 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f4e482c7-87bc-4694-b4be-45137a5688fb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:35.918919 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-f4e482c7-87bc-4694-b4be-45137a5688fb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 200 len: 38326 microversion: 2.20 time: 0.163049 Nov 23 07:48:35.925418 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 401/771] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:35 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 38326 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:48:35.935192 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-7558af55-e1b7-4131-9de6-86e74765094f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:35.936473 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-7558af55-e1b7-4131-9de6-86e74765094f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:35.949382 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7558af55-e1b7-4131-9de6-86e74765094f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:35.950723 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7558af55-e1b7-4131-9de6-86e74765094f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:35.951604 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7558af55-e1b7-4131-9de6-86e74765094f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:35.952137 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7558af55-e1b7-4131-9de6-86e74765094f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:35.984454 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-7558af55-e1b7-4131-9de6-86e74765094f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/ips" status: 200 len: 152 microversion: 2.20 time: 0.056250 Nov 23 07:48:35.994424 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 371/772] 10.222.0.48 () {60 vars in 1288 bytes} [Tue Nov 23 07:48:35 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/ips => generated 152 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:48:36.458423 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1100ab0f-673b-4398-b901-f897a3632fd1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:36.460065 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1100ab0f-673b-4398-b901-f897a3632fd1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:36.486571 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1100ab0f-673b-4398-b901-f897a3632fd1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:36.488690 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1100ab0f-673b-4398-b901-f897a3632fd1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:36.491317 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1100ab0f-673b-4398-b901-f897a3632fd1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:36.492000 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1100ab0f-673b-4398-b901-f897a3632fd1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:36.609468 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1100ab0f-673b-4398-b901-f897a3632fd1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 14 microversion: 2.1 time: 0.155536 Nov 23 07:48:36.611777 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 402/773] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:36 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:48:37.629669 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-8f5e704c-3af3-4427-a04f-8eee205d2dc3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:37.632395 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-8f5e704c-3af3-4427-a04f-8eee205d2dc3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:37.655239 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8f5e704c-3af3-4427-a04f-8eee205d2dc3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:37.656397 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8f5e704c-3af3-4427-a04f-8eee205d2dc3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:37.658188 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8f5e704c-3af3-4427-a04f-8eee205d2dc3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:37.659008 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8f5e704c-3af3-4427-a04f-8eee205d2dc3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:37.787391 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-8f5e704c-3af3-4427-a04f-8eee205d2dc3 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 247 microversion: 2.1 time: 0.164341 Nov 23 07:48:37.789785 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 372/774] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:37 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 247 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:48:38.474321 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8d8b1256-a66b-4aa5-8b33-20063c73578e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:38.480985 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8d8b1256-a66b-4aa5-8b33-20063c73578e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:38.508872 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8d8b1256-a66b-4aa5-8b33-20063c73578e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:38.509474 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8d8b1256-a66b-4aa5-8b33-20063c73578e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:38.511609 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8d8b1256-a66b-4aa5-8b33-20063c73578e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:38.512150 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8d8b1256-a66b-4aa5-8b33-20063c73578e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:38.544421 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.objects.instance [None req-8d8b1256-a66b-4aa5-8b33-20063c73578e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lazy-loading 'flavor' on Instance uuid 36d02284-ac69-4605-bd8e-1c29644f219c {{(pid=122786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:48:38.809152 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-90c80c32-3e4b-4a58-a2ca-72c657ee9a63 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:38.811338 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-90c80c32-3e4b-4a58-a2ca-72c657ee9a63 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:38.820356 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-90c80c32-3e4b-4a58-a2ca-72c657ee9a63 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:38.820815 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-90c80c32-3e4b-4a58-a2ca-72c657ee9a63 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:38.821643 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-90c80c32-3e4b-4a58-a2ca-72c657ee9a63 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:38.822250 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-90c80c32-3e4b-4a58-a2ca-72c657ee9a63 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:38.870339 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-8d8b1256-a66b-4aa5-8b33-20063c73578e tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 202 len: 0 microversion: 2.20 time: 0.404021 Nov 23 07:48:38.872379 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 403/775] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:48:38 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 07:48:38.883095 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-70cbda80-804a-45d7-90cc-7a797fbbe95c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:38.883826 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-70cbda80-804a-45d7-90cc-7a797fbbe95c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:38.892400 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-70cbda80-804a-45d7-90cc-7a797fbbe95c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:38.892933 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-70cbda80-804a-45d7-90cc-7a797fbbe95c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:38.895642 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-70cbda80-804a-45d7-90cc-7a797fbbe95c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:38.896102 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-70cbda80-804a-45d7-90cc-7a797fbbe95c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:38.913843 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-90c80c32-3e4b-4a58-a2ca-72c657ee9a63 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 11454 microversion: 2.1 time: 0.116852 Nov 23 07:48:38.914519 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 373/776] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:38 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 11454 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:48:39.072904 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-70cbda80-804a-45d7-90cc-7a797fbbe95c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:39.087144 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-70cbda80-804a-45d7-90cc-7a797fbbe95c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:39.088880 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-70cbda80-804a-45d7-90cc-7a797fbbe95c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:39.090196 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-70cbda80-804a-45d7-90cc-7a797fbbe95c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1722 microversion: 2.20 time: 0.213601 Nov 23 07:48:39.090990 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 404/777] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:48:38 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:48:39.925582 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d65b9837-5ce0-4f21-9f49-829290353371 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:39.927665 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d65b9837-5ce0-4f21-9f49-829290353371 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:39.938286 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d65b9837-5ce0-4f21-9f49-829290353371 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:39.939033 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d65b9837-5ce0-4f21-9f49-829290353371 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:39.940609 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d65b9837-5ce0-4f21-9f49-829290353371 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:39.941233 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d65b9837-5ce0-4f21-9f49-829290353371 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:40.022585 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d65b9837-5ce0-4f21-9f49-829290353371 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 17602 microversion: 2.1 time: 0.100634 Nov 23 07:48:40.028343 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 374/778] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:39 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 17602 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:48:40.111686 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-18d61c87-edd6-4634-b6cf-87161d5f658c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:40.113021 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-18d61c87-edd6-4634-b6cf-87161d5f658c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:40.124188 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-18d61c87-edd6-4634-b6cf-87161d5f658c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:40.124607 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-18d61c87-edd6-4634-b6cf-87161d5f658c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:40.125694 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-18d61c87-edd6-4634-b6cf-87161d5f658c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:40.126203 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-18d61c87-edd6-4634-b6cf-87161d5f658c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:40.422611 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-18d61c87-edd6-4634-b6cf-87161d5f658c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:40.436983 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-18d61c87-edd6-4634-b6cf-87161d5f658c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:40.440304 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-18d61c87-edd6-4634-b6cf-87161d5f658c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:40.442913 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-18d61c87-edd6-4634-b6cf-87161d5f658c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1722 microversion: 2.20 time: 0.335000 Nov 23 07:48:40.444503 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 405/779] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:48:40 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1722 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:48:41.039880 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-7d219338-2e50-4667-985b-97e0aafb4a37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:41.041020 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-7d219338-2e50-4667-985b-97e0aafb4a37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:41.054835 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7d219338-2e50-4667-985b-97e0aafb4a37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:41.055975 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7d219338-2e50-4667-985b-97e0aafb4a37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:41.059943 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7d219338-2e50-4667-985b-97e0aafb4a37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:41.061335 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7d219338-2e50-4667-985b-97e0aafb4a37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:41.188439 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-7d219338-2e50-4667-985b-97e0aafb4a37 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 18083 microversion: 2.1 time: 0.149027 Nov 23 07:48:41.191305 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 375/780] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:41 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 18083 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:48:41.475384 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6c6984de-ce49-48b5-9b48-9db19f547d25 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:41.477674 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6c6984de-ce49-48b5-9b48-9db19f547d25 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:41.492353 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6c6984de-ce49-48b5-9b48-9db19f547d25 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:41.492960 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6c6984de-ce49-48b5-9b48-9db19f547d25 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:41.494789 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6c6984de-ce49-48b5-9b48-9db19f547d25 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:41.495798 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6c6984de-ce49-48b5-9b48-9db19f547d25 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:41.924637 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6c6984de-ce49-48b5-9b48-9db19f547d25 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:41.948559 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6c6984de-ce49-48b5-9b48-9db19f547d25 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:41.952514 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6c6984de-ce49-48b5-9b48-9db19f547d25 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:41.956101 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6c6984de-ce49-48b5-9b48-9db19f547d25 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1722 microversion: 2.20 time: 0.487052 Nov 23 07:48:41.957226 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 406/781] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:48:41 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1722 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:48:42.203927 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3dcb4465-022e-4216-8b71-790f424ea6cd tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:42.206189 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3dcb4465-022e-4216-8b71-790f424ea6cd tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:42.214658 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3dcb4465-022e-4216-8b71-790f424ea6cd tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:42.215557 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3dcb4465-022e-4216-8b71-790f424ea6cd tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:42.216731 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3dcb4465-022e-4216-8b71-790f424ea6cd tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:42.218160 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3dcb4465-022e-4216-8b71-790f424ea6cd tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:42.370135 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3dcb4465-022e-4216-8b71-790f424ea6cd tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 20839 microversion: 2.1 time: 0.170266 Nov 23 07:48:42.372188 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 376/782] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:42 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 20839 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:48:42.984974 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-31326d4f-7c34-4bd1-a1a9-fb619891f154 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:42.987671 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-31326d4f-7c34-4bd1-a1a9-fb619891f154 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:43.050917 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-31326d4f-7c34-4bd1-a1a9-fb619891f154 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:43.067034 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-31326d4f-7c34-4bd1-a1a9-fb619891f154 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:43.070260 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-31326d4f-7c34-4bd1-a1a9-fb619891f154 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:43.074244 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-31326d4f-7c34-4bd1-a1a9-fb619891f154 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:43.385341 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-79c59da8-12a5-4b13-9480-b2d89436e47a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:43.386468 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-79c59da8-12a5-4b13-9480-b2d89436e47a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:43.390577 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-31326d4f-7c34-4bd1-a1a9-fb619891f154 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:43.400753 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-79c59da8-12a5-4b13-9480-b2d89436e47a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:43.401206 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-79c59da8-12a5-4b13-9480-b2d89436e47a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:43.404682 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-79c59da8-12a5-4b13-9480-b2d89436e47a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:43.408134 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-79c59da8-12a5-4b13-9480-b2d89436e47a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:43.415935 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-31326d4f-7c34-4bd1-a1a9-fb619891f154 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:43.423936 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-31326d4f-7c34-4bd1-a1a9-fb619891f154 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:43.426678 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-31326d4f-7c34-4bd1-a1a9-fb619891f154 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1722 microversion: 2.20 time: 0.454299 Nov 23 07:48:43.427865 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 407/783] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:48:42 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1722 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:48:43.538960 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-79c59da8-12a5-4b13-9480-b2d89436e47a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 22433 microversion: 2.1 time: 0.153688 Nov 23 07:48:43.549280 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 377/784] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:43 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 22433 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:48:44.057443 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d429a899-ce4f-47b3-a8e3-66b9e71b5815 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2005560618", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1953697943", "security_groups": [{"name": "tempest-secgroup-smoke-260761691"}], "networks": [{"uuid": "6b5935e7-9d75-48af-991a-f9db01f37912"}], "block_device_mapping_v2": [{"uuid": "75e03a9b-392c-43a2-97c3-afc65dc470fb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:44.310137 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.network.neutron [None req-d429a899-ce4f-47b3-a8e3-66b9e71b5815 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] validate_networks() for [('6b5935e7-9d75-48af-991a-f9db01f37912', None, None, None, None, None)] {{(pid=122786) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:48:44.454143 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-a04d4803-04db-4ade-8c73-24ab69582ccd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:44.455451 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-a04d4803-04db-4ade-8c73-24ab69582ccd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:44.487796 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a04d4803-04db-4ade-8c73-24ab69582ccd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:44.488565 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a04d4803-04db-4ade-8c73-24ab69582ccd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:44.492628 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a04d4803-04db-4ade-8c73-24ab69582ccd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:44.493226 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a04d4803-04db-4ade-8c73-24ab69582ccd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:44.905913 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a04d4803-04db-4ade-8c73-24ab69582ccd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:44.917774 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a04d4803-04db-4ade-8c73-24ab69582ccd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:44.921039 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a04d4803-04db-4ade-8c73-24ab69582ccd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:44.923862 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-a04d4803-04db-4ade-8c73-24ab69582ccd tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1722 microversion: 2.20 time: 0.479263 Nov 23 07:48:44.925056 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 378/785] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:48:44 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1722 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:48:44.930344 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-921d5a09-3a63-4f69-a6fd-51b7ebd199a5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:44.931630 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-921d5a09-3a63-4f69-a6fd-51b7ebd199a5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:44.940661 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-921d5a09-3a63-4f69-a6fd-51b7ebd199a5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:44.941446 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-921d5a09-3a63-4f69-a6fd-51b7ebd199a5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:44.942738 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-921d5a09-3a63-4f69-a6fd-51b7ebd199a5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:44.943755 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-921d5a09-3a63-4f69-a6fd-51b7ebd199a5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:45.041215 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-921d5a09-3a63-4f69-a6fd-51b7ebd199a5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 23798 microversion: 2.1 time: 0.113967 Nov 23 07:48:45.043041 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 379/786] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:44 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 23798 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:48:45.444471 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-d429a899-ce4f-47b3-a8e3-66b9e71b5815 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Flavor limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:48:45.445012 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-d429a899-ce4f-47b3-a8e3-66b9e71b5815 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Image limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:48:45.445349 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-d429a899-ce4f-47b3-a8e3-66b9e71b5815 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Flavor pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:48:45.447705 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-d429a899-ce4f-47b3-a8e3-66b9e71b5815 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Image pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:48:45.448145 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-d429a899-ce4f-47b3-a8e3-66b9e71b5815 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:48:45.473544 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d429a899-ce4f-47b3-a8e3-66b9e71b5815 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:45.474397 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d429a899-ce4f-47b3-a8e3-66b9e71b5815 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:45.475494 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d429a899-ce4f-47b3-a8e3-66b9e71b5815 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:45.476435 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d429a899-ce4f-47b3-a8e3-66b9e71b5815 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:45.504363 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-d429a899-ce4f-47b3-a8e3-66b9e71b5815 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Getting quotas for project 2d805701d3af40f59df0733595904769. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:48:45.510908 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-d429a899-ce4f-47b3-a8e3-66b9e71b5815 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Getting quotas for user 49e051a1a3934a12a2485cf6a2504932 and project 2d805701d3af40f59df0733595904769. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:48:45.600258 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d429a899-ce4f-47b3-a8e3-66b9e71b5815 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Going to run 1 instances... {{(pid=122786) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:48:45.606219 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d429a899-ce4f-47b3-a8e3-66b9e71b5815 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='75e03a9b-392c-43a2-97c3-afc65dc470fb',volume_size=None,volume_type=None)] {{(pid=122786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:48:45.763526 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f1565922-01b2-4539-b02b-8b73437c7ec6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Action: 'create', calling method: .version_select at 0x7f0507f4eca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-592728128"}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:45.787515 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-f1565922-01b2-4539-b02b-8b73437c7ec6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Getting quotas for project 923ced17fbea41d2bb472b52dd316477. Resources: {'key_pairs'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:48:45.796313 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-f1565922-01b2-4539-b02b-8b73437c7ec6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Getting quotas for user cbb14b561f25411684be4c930e712800 and project 923ced17fbea41d2bb472b52dd316477. Resources: {'key_pairs'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:48:45.822439 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d429a899-ce4f-47b3-a8e3-66b9e71b5815 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.769417 Nov 23 07:48:45.830700 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 408/787] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Nov 23 07:48:44 2021] POST /compute/v2.1/servers => generated 405 bytes in 1776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 07:48:45.837321 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e010f814-f7a5-4662-9183-3c7736d3a92c tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:45.838523 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e010f814-f7a5-4662-9183-3c7736d3a92c tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:45.946519 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-e010f814-f7a5-4662-9183-3c7736d3a92c tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:45.967375 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e010f814-f7a5-4662-9183-3c7736d3a92c tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1089 microversion: 2.1 time: 0.133997 Nov 23 07:48:45.978018 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 409/788] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:45 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1089 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:48:45.978729 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d607d68d-f4b1-4f73-bd5b-e9960db083b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:45.985788 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d607d68d-f4b1-4f73-bd5b-e9960db083b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:45.995728 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-f1565922-01b2-4539-b02b-8b73437c7ec6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Getting quotas for project 923ced17fbea41d2bb472b52dd316477. Resources: {'key_pairs'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:48:46.004695 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-f1565922-01b2-4539-b02b-8b73437c7ec6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Getting quotas for user cbb14b561f25411684be4c930e712800 and project 923ced17fbea41d2bb472b52dd316477. Resources: {'key_pairs'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:48:46.008406 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d607d68d-f4b1-4f73-bd5b-e9960db083b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:46.008957 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d607d68d-f4b1-4f73-bd5b-e9960db083b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:46.010389 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d607d68d-f4b1-4f73-bd5b-e9960db083b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:46.011141 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d607d68d-f4b1-4f73-bd5b-e9960db083b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:46.031326 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f1565922-01b2-4539-b02b-8b73437c7ec6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.507993 Nov 23 07:48:46.031983 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 380/789] 10.222.0.48 () {60 vars in 1157 bytes} [Tue Nov 23 07:48:45 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:46.058935 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-dc90a200-dd62-4428-9155-e93aac827f21 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:46.060217 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-dc90a200-dd62-4428-9155-e93aac827f21 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:46.071368 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-dc90a200-dd62-4428-9155-e93aac827f21 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:46.072050 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-dc90a200-dd62-4428-9155-e93aac827f21 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:46.073371 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-dc90a200-dd62-4428-9155-e93aac827f21 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:46.074210 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-dc90a200-dd62-4428-9155-e93aac827f21 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:46.217002 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-dc90a200-dd62-4428-9155-e93aac827f21 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 25612 microversion: 2.1 time: 0.161075 Nov 23 07:48:46.220482 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 381/790] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:46 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 25612 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:48:46.272096 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d607d68d-f4b1-4f73-bd5b-e9960db083b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:46.281012 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d607d68d-f4b1-4f73-bd5b-e9960db083b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:46.282920 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d607d68d-f4b1-4f73-bd5b-e9960db083b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:46.284476 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d607d68d-f4b1-4f73-bd5b-e9960db083b5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1722 microversion: 2.20 time: 0.314080 Nov 23 07:48:46.285238 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 410/791] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:48:45 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1722 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:48:47.005217 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ff86883a-c143-4234-99dc-aee2c12654f0 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:47.005978 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ff86883a-c143-4234-99dc-aee2c12654f0 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:47.013613 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ff86883a-c143-4234-99dc-aee2c12654f0 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:47.014276 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ff86883a-c143-4234-99dc-aee2c12654f0 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:47.015200 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ff86883a-c143-4234-99dc-aee2c12654f0 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:47.015708 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ff86883a-c143-4234-99dc-aee2c12654f0 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:47.125188 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ff86883a-c143-4234-99dc-aee2c12654f0 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:47.145049 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ff86883a-c143-4234-99dc-aee2c12654f0 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1187 microversion: 2.1 time: 0.143554 Nov 23 07:48:47.146673 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 382/792] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:46 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1187 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:47.254273 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6c96d603-e16f-4947-9563-e15ba45d27e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:47.256582 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6c96d603-e16f-4947-9563-e15ba45d27e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:47.272387 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6c96d603-e16f-4947-9563-e15ba45d27e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:47.273325 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6c96d603-e16f-4947-9563-e15ba45d27e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:47.275382 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6c96d603-e16f-4947-9563-e15ba45d27e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:47.276444 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6c96d603-e16f-4947-9563-e15ba45d27e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:47.307474 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ca6c4385-be06-46b8-a6b4-eb13a1c977f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:47.308215 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ca6c4385-be06-46b8-a6b4-eb13a1c977f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:47.323152 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ca6c4385-be06-46b8-a6b4-eb13a1c977f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:47.323841 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ca6c4385-be06-46b8-a6b4-eb13a1c977f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:47.325101 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ca6c4385-be06-46b8-a6b4-eb13a1c977f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:47.325811 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ca6c4385-be06-46b8-a6b4-eb13a1c977f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:47.411057 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6c96d603-e16f-4947-9563-e15ba45d27e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 26831 microversion: 2.1 time: 0.162455 Nov 23 07:48:47.413288 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 411/793] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:47 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 26831 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:48:47.789934 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ca6c4385-be06-46b8-a6b4-eb13a1c977f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:47.801464 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ca6c4385-be06-46b8-a6b4-eb13a1c977f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:47.806274 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ca6c4385-be06-46b8-a6b4-eb13a1c977f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:47.808698 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ca6c4385-be06-46b8-a6b4-eb13a1c977f3 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1722 microversion: 2.20 time: 0.504906 Nov 23 07:48:47.820193 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 383/794] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:48:47 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1722 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:48:48.167936 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-985f57ef-765e-4bb6-bcf9-2b37ee55fff3 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:48.169491 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-985f57ef-765e-4bb6-bcf9-2b37ee55fff3 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:48.180418 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-985f57ef-765e-4bb6-bcf9-2b37ee55fff3 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:48.181053 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-985f57ef-765e-4bb6-bcf9-2b37ee55fff3 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:48.182123 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-985f57ef-765e-4bb6-bcf9-2b37ee55fff3 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:48.182669 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-985f57ef-765e-4bb6-bcf9-2b37ee55fff3 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:48.294865 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-985f57ef-765e-4bb6-bcf9-2b37ee55fff3 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:48.307942 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-985f57ef-765e-4bb6-bcf9-2b37ee55fff3 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1205 microversion: 2.1 time: 0.145798 Nov 23 07:48:48.309555 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 412/795] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:48 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1205 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:48.431369 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-1e47912f-b0d9-4b0d-bfbb-26c1c640b59c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:48.433416 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-1e47912f-b0d9-4b0d-bfbb-26c1c640b59c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:48.462041 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1e47912f-b0d9-4b0d-bfbb-26c1c640b59c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:48.464229 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1e47912f-b0d9-4b0d-bfbb-26c1c640b59c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:48.465326 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1e47912f-b0d9-4b0d-bfbb-26c1c640b59c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:48.467423 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1e47912f-b0d9-4b0d-bfbb-26c1c640b59c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:48.598565 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-1e47912f-b0d9-4b0d-bfbb-26c1c640b59c tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 27512 microversion: 2.1 time: 0.175755 Nov 23 07:48:48.599725 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 384/796] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:48 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 27512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:48:48.840928 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-bfe162d8-a48a-4600-bd11-f78aef5d8ea8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:48.842507 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-bfe162d8-a48a-4600-bd11-f78aef5d8ea8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:48.875936 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bfe162d8-a48a-4600-bd11-f78aef5d8ea8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:48.877261 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bfe162d8-a48a-4600-bd11-f78aef5d8ea8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:48.879323 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bfe162d8-a48a-4600-bd11-f78aef5d8ea8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:48.880733 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-bfe162d8-a48a-4600-bd11-f78aef5d8ea8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:49.145617 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-bfe162d8-a48a-4600-bd11-f78aef5d8ea8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:49.157330 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-bfe162d8-a48a-4600-bd11-f78aef5d8ea8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:49.159631 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-bfe162d8-a48a-4600-bd11-f78aef5d8ea8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:49.161155 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-bfe162d8-a48a-4600-bd11-f78aef5d8ea8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1722 microversion: 2.20 time: 0.331025 Nov 23 07:48:49.161809 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 413/797] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:48:48 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1722 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:48:49.341308 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f1395d86-4496-4ec2-84ab-935423a22f62 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:49.343129 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f1395d86-4496-4ec2-84ab-935423a22f62 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:49.356689 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f1395d86-4496-4ec2-84ab-935423a22f62 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:49.357971 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f1395d86-4496-4ec2-84ab-935423a22f62 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:49.359693 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f1395d86-4496-4ec2-84ab-935423a22f62 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:49.360750 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f1395d86-4496-4ec2-84ab-935423a22f62 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:49.617874 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-9b8b566e-80f8-4f03-8806-f06fa8b9b7d9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:49.619464 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-9b8b566e-80f8-4f03-8806-f06fa8b9b7d9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:49.631637 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9b8b566e-80f8-4f03-8806-f06fa8b9b7d9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:49.632466 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9b8b566e-80f8-4f03-8806-f06fa8b9b7d9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:49.633435 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9b8b566e-80f8-4f03-8806-f06fa8b9b7d9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:49.634189 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9b8b566e-80f8-4f03-8806-f06fa8b9b7d9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:49.770107 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-9b8b566e-80f8-4f03-8806-f06fa8b9b7d9 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 27843 microversion: 2.1 time: 0.159590 Nov 23 07:48:49.783425 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 414/798] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:49 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 27843 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:48:49.843049 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f1395d86-4496-4ec2-84ab-935423a22f62 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:49.865595 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f1395d86-4496-4ec2-84ab-935423a22f62 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1260 microversion: 2.1 time: 0.528804 Nov 23 07:48:49.877919 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 385/799] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:49 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1260 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:50.194663 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-73d8dfb0-dcf4-4c2e-be53-ff560a888f40 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:50.196588 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-73d8dfb0-dcf4-4c2e-be53-ff560a888f40 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:50.226139 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-73d8dfb0-dcf4-4c2e-be53-ff560a888f40 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:50.229297 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-73d8dfb0-dcf4-4c2e-be53-ff560a888f40 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:50.239514 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-73d8dfb0-dcf4-4c2e-be53-ff560a888f40 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:50.240324 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-73d8dfb0-dcf4-4c2e-be53-ff560a888f40 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:50.275769 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-eba2964e-36b6-4ab8-bc7d-2d01578c8d74 req-af509fe7-8b66-448f-861f-f89179c0e59c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be38773-5840-4e15-b2f5-ce77caceb858", "tag": "a7bd6f41-4ac3-41e3-8d6f-dd2993595bc7"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:50.278993 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:48:50.278993 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:48:50.301333 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-eba2964e-36b6-4ab8-bc7d-2d01578c8d74 req-af509fe7-8b66-448f-861f-f89179c0e59c service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:50.307696 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-eba2964e-36b6-4ab8-bc7d-2d01578c8d74 req-af509fe7-8b66-448f-861f-f89179c0e59c service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:50.334826 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-eba2964e-36b6-4ab8-bc7d-2d01578c8d74 req-af509fe7-8b66-448f-861f-f89179c0e59c service nova] Creating event network-changed:a7bd6f41-4ac3-41e3-8d6f-dd2993595bc7 for instance 4be38773-5840-4e15-b2f5-ce77caceb858 on hv-cinder-80403 Nov 23 07:48:50.344014 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-eba2964e-36b6-4ab8-bc7d-2d01578c8d74 req-af509fe7-8b66-448f-861f-f89179c0e59c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.244427 Nov 23 07:48:50.349575 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 415/800] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:48:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:48:50.795530 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-3bf654d0-d5c1-44f3-b8c4-de73f485b261 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:50.798734 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-3bf654d0-d5c1-44f3-b8c4-de73f485b261 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:50.811930 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3bf654d0-d5c1-44f3-b8c4-de73f485b261 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:50.812795 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3bf654d0-d5c1-44f3-b8c4-de73f485b261 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:50.814862 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3bf654d0-d5c1-44f3-b8c4-de73f485b261 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:50.815897 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3bf654d0-d5c1-44f3-b8c4-de73f485b261 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:50.938264 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-3bf654d0-d5c1-44f3-b8c4-de73f485b261 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 28186 microversion: 2.1 time: 0.149476 Nov 23 07:48:50.940688 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 416/801] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:50 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 28186 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:48:50.960337 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6ae62d37-410a-4570-8d00-95515333a90d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:50.966505 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6ae62d37-410a-4570-8d00-95515333a90d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:51.012706 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6ae62d37-410a-4570-8d00-95515333a90d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:51.020027 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6ae62d37-410a-4570-8d00-95515333a90d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:51.025800 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6ae62d37-410a-4570-8d00-95515333a90d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:51.026985 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6ae62d37-410a-4570-8d00-95515333a90d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:51.109919 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-73d8dfb0-dcf4-4c2e-be53-ff560a888f40 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:51.146134 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-73d8dfb0-dcf4-4c2e-be53-ff560a888f40 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:51.149993 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-73d8dfb0-dcf4-4c2e-be53-ff560a888f40 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:51.156842 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-73d8dfb0-dcf4-4c2e-be53-ff560a888f40 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1743 microversion: 2.20 time: 0.978351 Nov 23 07:48:51.158960 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 386/802] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:48:50 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1743 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:48:51.502023 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6ae62d37-410a-4570-8d00-95515333a90d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:51.520634 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6ae62d37-410a-4570-8d00-95515333a90d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1260 microversion: 2.1 time: 0.574932 Nov 23 07:48:51.522080 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 417/803] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:50 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1260 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:51.954562 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-06169baa-74bf-413d-acc5-6541a4f6153a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:51.955676 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-06169baa-74bf-413d-acc5-6541a4f6153a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:51.965387 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-06169baa-74bf-413d-acc5-6541a4f6153a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:51.965870 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-06169baa-74bf-413d-acc5-6541a4f6153a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:51.966929 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-06169baa-74bf-413d-acc5-6541a4f6153a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:51.967582 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-06169baa-74bf-413d-acc5-6541a4f6153a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:52.046225 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-06169baa-74bf-413d-acc5-6541a4f6153a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 28186 microversion: 2.1 time: 0.095303 Nov 23 07:48:52.047246 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 387/804] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:51 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 28186 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:48:52.198612 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1f4f58aa-c0e1-458a-8eae-665e01fd9644 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:52.200236 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1f4f58aa-c0e1-458a-8eae-665e01fd9644 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:52.209371 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1f4f58aa-c0e1-458a-8eae-665e01fd9644 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:52.211206 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1f4f58aa-c0e1-458a-8eae-665e01fd9644 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:52.212400 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1f4f58aa-c0e1-458a-8eae-665e01fd9644 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:52.213106 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1f4f58aa-c0e1-458a-8eae-665e01fd9644 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:52.452541 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1f4f58aa-c0e1-458a-8eae-665e01fd9644 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:52.463333 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1f4f58aa-c0e1-458a-8eae-665e01fd9644 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:52.468394 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1f4f58aa-c0e1-458a-8eae-665e01fd9644 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:52.469743 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1f4f58aa-c0e1-458a-8eae-665e01fd9644 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1738 microversion: 2.20 time: 0.279382 Nov 23 07:48:52.470692 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 418/805] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:48:52 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:48:52.556639 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-af0fce50-472f-427e-a180-f08d1db5fb35 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:52.558230 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-af0fce50-472f-427e-a180-f08d1db5fb35 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:52.576775 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-af0fce50-472f-427e-a180-f08d1db5fb35 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:52.577335 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-af0fce50-472f-427e-a180-f08d1db5fb35 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:52.580852 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-af0fce50-472f-427e-a180-f08d1db5fb35 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:52.584260 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-af0fce50-472f-427e-a180-f08d1db5fb35 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:52.803107 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-af0fce50-472f-427e-a180-f08d1db5fb35 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:52.815861 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-af0fce50-472f-427e-a180-f08d1db5fb35 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1260 microversion: 2.1 time: 0.265726 Nov 23 07:48:52.831723 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 388/806] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:52 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1260 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:53.067367 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-e4905df3-2521-4b04-affb-64986175571d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:53.069222 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-e4905df3-2521-4b04-affb-64986175571d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:53.090748 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e4905df3-2521-4b04-affb-64986175571d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:53.091500 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e4905df3-2521-4b04-affb-64986175571d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:53.093600 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e4905df3-2521-4b04-affb-64986175571d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:53.094942 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e4905df3-2521-4b04-affb-64986175571d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:53.207032 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-e4905df3-2521-4b04-affb-64986175571d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 28186 microversion: 2.1 time: 0.149954 Nov 23 07:48:53.208559 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 389/807] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:53 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 28186 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:48:53.257801 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-d8630893-e0ea-4e11-b3ae-1e30441013df req-d1e6c3b3-6aba-4358-9090-bb976efdbdac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d02284-ac69-4605-bd8e-1c29644f219c", "name": "network-vif-plugged", "status": "completed", "tag": "7bb628ce-17b8-43a9-8265-270514936b86"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:53.260683 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:48:53.260683 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:48:53.272582 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-d8630893-e0ea-4e11-b3ae-1e30441013df req-d1e6c3b3-6aba-4358-9090-bb976efdbdac service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:53.273067 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-d8630893-e0ea-4e11-b3ae-1e30441013df req-d1e6c3b3-6aba-4358-9090-bb976efdbdac service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:53.295217 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-d8630893-e0ea-4e11-b3ae-1e30441013df req-d1e6c3b3-6aba-4358-9090-bb976efdbdac service nova] Creating event network-vif-plugged:7bb628ce-17b8-43a9-8265-270514936b86 for instance 36d02284-ac69-4605-bd8e-1c29644f219c on hv-cinder-80403 Nov 23 07:48:53.304927 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-d8630893-e0ea-4e11-b3ae-1e30441013df req-d1e6c3b3-6aba-4358-9090-bb976efdbdac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.252500 Nov 23 07:48:53.305967 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 419/808] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:48:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:48:53.492790 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-0475661a-a05a-4bd6-b7d4-a4420b2bc8e1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:53.496430 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-0475661a-a05a-4bd6-b7d4-a4420b2bc8e1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:53.506393 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0475661a-a05a-4bd6-b7d4-a4420b2bc8e1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:53.506756 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0475661a-a05a-4bd6-b7d4-a4420b2bc8e1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:53.507691 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0475661a-a05a-4bd6-b7d4-a4420b2bc8e1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:53.508131 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0475661a-a05a-4bd6-b7d4-a4420b2bc8e1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:53.732523 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0475661a-a05a-4bd6-b7d4-a4420b2bc8e1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:53.750950 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0475661a-a05a-4bd6-b7d4-a4420b2bc8e1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:53.755731 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0475661a-a05a-4bd6-b7d4-a4420b2bc8e1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:53.758519 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-0475661a-a05a-4bd6-b7d4-a4420b2bc8e1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1738 microversion: 2.20 time: 0.272285 Nov 23 07:48:53.780582 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 390/809] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:48:53 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1738 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:48:53.838216 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-f42c7a0d-75c4-40f9-8ed0-62030dec1f16 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:53.843637 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f42c7a0d-75c4-40f9-8ed0-62030dec1f16 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:53.856355 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f42c7a0d-75c4-40f9-8ed0-62030dec1f16 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:53.857126 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f42c7a0d-75c4-40f9-8ed0-62030dec1f16 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:53.858283 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f42c7a0d-75c4-40f9-8ed0-62030dec1f16 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:53.858718 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f42c7a0d-75c4-40f9-8ed0-62030dec1f16 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:54.157149 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-f42c7a0d-75c4-40f9-8ed0-62030dec1f16 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:54.173776 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-f42c7a0d-75c4-40f9-8ed0-62030dec1f16 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1260 microversion: 2.1 time: 0.341089 Nov 23 07:48:54.175042 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 420/810] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:53 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1260 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:54.224370 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-7f29726a-980a-460f-aac4-040c14ea087b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:54.228324 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-7f29726a-980a-460f-aac4-040c14ea087b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:54.242186 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7f29726a-980a-460f-aac4-040c14ea087b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:54.243434 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7f29726a-980a-460f-aac4-040c14ea087b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:54.244892 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7f29726a-980a-460f-aac4-040c14ea087b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:54.246569 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-7f29726a-980a-460f-aac4-040c14ea087b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:54.368934 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-7f29726a-980a-460f-aac4-040c14ea087b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 28428 microversion: 2.1 time: 0.151242 Nov 23 07:48:54.369856 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 391/811] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:54 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 28428 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:48:54.795558 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ccd8cfc0-2be1-4ca8-9d10-90a1ac531d2a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:54.797744 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ccd8cfc0-2be1-4ca8-9d10-90a1ac531d2a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:54.809991 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ccd8cfc0-2be1-4ca8-9d10-90a1ac531d2a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:54.811253 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ccd8cfc0-2be1-4ca8-9d10-90a1ac531d2a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:54.813262 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ccd8cfc0-2be1-4ca8-9d10-90a1ac531d2a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:54.815438 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ccd8cfc0-2be1-4ca8-9d10-90a1ac531d2a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:55.138313 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ccd8cfc0-2be1-4ca8-9d10-90a1ac531d2a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:55.158002 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ccd8cfc0-2be1-4ca8-9d10-90a1ac531d2a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:55.161463 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ccd8cfc0-2be1-4ca8-9d10-90a1ac531d2a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:55.167194 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ccd8cfc0-2be1-4ca8-9d10-90a1ac531d2a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1738 microversion: 2.20 time: 0.375909 Nov 23 07:48:55.167194 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 421/812] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:48:54 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1738 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:48:55.201293 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ac3655ce-4c91-4743-afc8-b285a13f515d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:55.202788 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ac3655ce-4c91-4743-afc8-b285a13f515d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:55.215843 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ac3655ce-4c91-4743-afc8-b285a13f515d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:55.216623 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ac3655ce-4c91-4743-afc8-b285a13f515d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:55.223571 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ac3655ce-4c91-4743-afc8-b285a13f515d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:55.224410 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ac3655ce-4c91-4743-afc8-b285a13f515d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:55.394996 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c0839a27-9529-4844-914a-3b69b2360375 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:55.396841 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c0839a27-9529-4844-914a-3b69b2360375 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:55.412354 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c0839a27-9529-4844-914a-3b69b2360375 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:55.413001 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c0839a27-9529-4844-914a-3b69b2360375 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:55.414316 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c0839a27-9529-4844-914a-3b69b2360375 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:55.415046 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c0839a27-9529-4844-914a-3b69b2360375 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:55.467662 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ac3655ce-4c91-4743-afc8-b285a13f515d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:55.476482 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ac3655ce-4c91-4743-afc8-b285a13f515d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1260 microversion: 2.1 time: 0.288321 Nov 23 07:48:55.477853 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 392/813] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:55 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1260 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:55.549947 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c0839a27-9529-4844-914a-3b69b2360375 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 28493 microversion: 2.1 time: 0.162438 Nov 23 07:48:55.552231 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 422/814] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:55 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 28493 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:48:56.197799 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5708df42-ddd8-4453-b466-b304d3588937 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:56.198648 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5708df42-ddd8-4453-b466-b304d3588937 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:56.206144 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5708df42-ddd8-4453-b466-b304d3588937 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:56.207082 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5708df42-ddd8-4453-b466-b304d3588937 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:56.208172 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5708df42-ddd8-4453-b466-b304d3588937 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:56.208756 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5708df42-ddd8-4453-b466-b304d3588937 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:56.434784 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5708df42-ddd8-4453-b466-b304d3588937 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:56.447429 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5708df42-ddd8-4453-b466-b304d3588937 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:56.449334 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5708df42-ddd8-4453-b466-b304d3588937 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:56.450803 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5708df42-ddd8-4453-b466-b304d3588937 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1738 microversion: 2.20 time: 0.257931 Nov 23 07:48:56.451984 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 393/815] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:48:56 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:48:56.502720 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a22330a6-5130-4bb9-903c-5443ee885b53 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:56.505418 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a22330a6-5130-4bb9-903c-5443ee885b53 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:56.517617 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a22330a6-5130-4bb9-903c-5443ee885b53 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:56.535762 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a22330a6-5130-4bb9-903c-5443ee885b53 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:56.537459 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a22330a6-5130-4bb9-903c-5443ee885b53 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:56.554130 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a22330a6-5130-4bb9-903c-5443ee885b53 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:56.567975 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-b67f8d9f-9709-49ac-ad42-60e18284d2f0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:56.569646 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-b67f8d9f-9709-49ac-ad42-60e18284d2f0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:56.580612 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b67f8d9f-9709-49ac-ad42-60e18284d2f0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:56.581570 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b67f8d9f-9709-49ac-ad42-60e18284d2f0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:56.583251 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b67f8d9f-9709-49ac-ad42-60e18284d2f0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:56.583836 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b67f8d9f-9709-49ac-ad42-60e18284d2f0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:56.673760 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-b67f8d9f-9709-49ac-ad42-60e18284d2f0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 28645 microversion: 2.1 time: 0.112238 Nov 23 07:48:56.674677 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 394/816] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:56 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 28645 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:48:56.790411 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a22330a6-5130-4bb9-903c-5443ee885b53 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:56.832890 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a22330a6-5130-4bb9-903c-5443ee885b53 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1260 microversion: 2.1 time: 0.336406 Nov 23 07:48:56.833561 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 423/817] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:56 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1260 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:57.472560 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-a7e5b265-d513-416c-b41b-935d2565fb9c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:57.475461 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-a7e5b265-d513-416c-b41b-935d2565fb9c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:57.489570 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a7e5b265-d513-416c-b41b-935d2565fb9c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:57.490286 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a7e5b265-d513-416c-b41b-935d2565fb9c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:57.491291 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a7e5b265-d513-416c-b41b-935d2565fb9c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:57.491901 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a7e5b265-d513-416c-b41b-935d2565fb9c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:57.699033 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-5921a715-5607-4c53-bfb9-cceab80ba081 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:57.708920 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-5921a715-5607-4c53-bfb9-cceab80ba081 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:57.723958 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5921a715-5607-4c53-bfb9-cceab80ba081 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:57.726887 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5921a715-5607-4c53-bfb9-cceab80ba081 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:57.728284 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5921a715-5607-4c53-bfb9-cceab80ba081 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:57.729115 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5921a715-5607-4c53-bfb9-cceab80ba081 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:57.834829 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a7e5b265-d513-416c-b41b-935d2565fb9c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:57.856667 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a7e5b265-d513-416c-b41b-935d2565fb9c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:57.859211 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a7e5b265-d513-416c-b41b-935d2565fb9c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:57.860508 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-a7e5b265-d513-416c-b41b-935d2565fb9c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1738 microversion: 2.20 time: 0.393677 Nov 23 07:48:57.861141 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 395/818] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:48:57 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1738 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:48:57.874013 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-b4bc8665-2fc1-45bb-9a4e-df4186c9a74f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:57.874422 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-5921a715-5607-4c53-bfb9-cceab80ba081 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 28645 microversion: 2.1 time: 0.190289 Nov 23 07:48:57.875657 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-b4bc8665-2fc1-45bb-9a4e-df4186c9a74f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:57.876469 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 424/819] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:57 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 28645 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:48:57.890363 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b4bc8665-2fc1-45bb-9a4e-df4186c9a74f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:57.891166 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b4bc8665-2fc1-45bb-9a4e-df4186c9a74f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:57.892631 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b4bc8665-2fc1-45bb-9a4e-df4186c9a74f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:57.893980 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b4bc8665-2fc1-45bb-9a4e-df4186c9a74f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:58.143413 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-b4bc8665-2fc1-45bb-9a4e-df4186c9a74f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:58.153071 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-b4bc8665-2fc1-45bb-9a4e-df4186c9a74f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1260 microversion: 2.1 time: 0.290534 Nov 23 07:48:58.165140 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 396/820] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:57 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1260 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:48:58.891949 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d4df2da6-f42b-4121-86c5-1d864619ce74 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:58.897695 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-cb4ca2a3-378d-4598-b2f6-73f945c67bf2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:48:58.899381 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d4df2da6-f42b-4121-86c5-1d864619ce74 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:58.903853 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-cb4ca2a3-378d-4598-b2f6-73f945c67bf2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:58.912409 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d4df2da6-f42b-4121-86c5-1d864619ce74 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:58.913601 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d4df2da6-f42b-4121-86c5-1d864619ce74 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:58.917194 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cb4ca2a3-378d-4598-b2f6-73f945c67bf2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:58.917950 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cb4ca2a3-378d-4598-b2f6-73f945c67bf2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:58.918935 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cb4ca2a3-378d-4598-b2f6-73f945c67bf2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:58.919553 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cb4ca2a3-378d-4598-b2f6-73f945c67bf2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:58.923186 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d4df2da6-f42b-4121-86c5-1d864619ce74 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:58.924540 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d4df2da6-f42b-4121-86c5-1d864619ce74 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:59.025551 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-cb4ca2a3-378d-4598-b2f6-73f945c67bf2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 28645 microversion: 2.1 time: 0.139609 Nov 23 07:48:59.026905 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 425/821] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:48:58 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 28645 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:48:59.120454 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d4df2da6-f42b-4121-86c5-1d864619ce74 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:59.131171 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d4df2da6-f42b-4121-86c5-1d864619ce74 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:59.132814 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d4df2da6-f42b-4121-86c5-1d864619ce74 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:59.134067 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d4df2da6-f42b-4121-86c5-1d864619ce74 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1738 microversion: 2.20 time: 0.246082 Nov 23 07:48:59.134652 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 397/822] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:48:58 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:48:59.181250 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-15fcaca5-d117-4849-9b40-86ea3cbb45dc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:48:59.181940 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-15fcaca5-d117-4849-9b40-86ea3cbb45dc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:48:59.190188 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-15fcaca5-d117-4849-9b40-86ea3cbb45dc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:59.190643 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-15fcaca5-d117-4849-9b40-86ea3cbb45dc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:59.191460 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-15fcaca5-d117-4849-9b40-86ea3cbb45dc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:48:59.191903 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-15fcaca5-d117-4849-9b40-86ea3cbb45dc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:48:59.426266 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-15fcaca5-d117-4849-9b40-86ea3cbb45dc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:48:59.434568 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-15fcaca5-d117-4849-9b40-86ea3cbb45dc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1260 microversion: 2.1 time: 0.257520 Nov 23 07:48:59.435174 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 426/823] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:48:59 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:00.040988 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-0a80dd9a-0e45-4c7a-8d15-95108a2c25e5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:00.041855 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-0a80dd9a-0e45-4c7a-8d15-95108a2c25e5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:00.050052 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0a80dd9a-0e45-4c7a-8d15-95108a2c25e5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:00.050877 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0a80dd9a-0e45-4c7a-8d15-95108a2c25e5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:00.052392 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0a80dd9a-0e45-4c7a-8d15-95108a2c25e5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:00.054652 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0a80dd9a-0e45-4c7a-8d15-95108a2c25e5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:00.164752 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-0fe244b1-1855-45da-9c3a-b62de83e3a3a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:00.165798 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-0fe244b1-1855-45da-9c3a-b62de83e3a3a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:00.168766 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-0a80dd9a-0e45-4c7a-8d15-95108a2c25e5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 28976 microversion: 2.1 time: 0.130894 Nov 23 07:49:00.173793 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 398/824] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:49:00 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 28976 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:49:00.175985 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0fe244b1-1855-45da-9c3a-b62de83e3a3a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:00.176752 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0fe244b1-1855-45da-9c3a-b62de83e3a3a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:00.178176 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0fe244b1-1855-45da-9c3a-b62de83e3a3a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:00.178937 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0fe244b1-1855-45da-9c3a-b62de83e3a3a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:00.429176 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-0fe244b1-1855-45da-9c3a-b62de83e3a3a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:00.451050 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-0fe244b1-1855-45da-9c3a-b62de83e3a3a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:00.454271 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-0fe244b1-1855-45da-9c3a-b62de83e3a3a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:00.456605 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-b22dd8dc-a5ca-4c1c-b216-60193a0cc764 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:00.457478 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-b22dd8dc-a5ca-4c1c-b216-60193a0cc764 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:00.457760 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-0fe244b1-1855-45da-9c3a-b62de83e3a3a tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1738 microversion: 2.20 time: 0.305159 Nov 23 07:49:00.459563 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 427/825] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:00 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1738 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:49:00.472097 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b22dd8dc-a5ca-4c1c-b216-60193a0cc764 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:00.474606 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b22dd8dc-a5ca-4c1c-b216-60193a0cc764 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:00.476552 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b22dd8dc-a5ca-4c1c-b216-60193a0cc764 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:00.477576 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b22dd8dc-a5ca-4c1c-b216-60193a0cc764 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:00.794159 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-b22dd8dc-a5ca-4c1c-b216-60193a0cc764 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:00.806577 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-b22dd8dc-a5ca-4c1c-b216-60193a0cc764 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1260 microversion: 2.1 time: 0.356198 Nov 23 07:49:00.824979 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 399/826] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:00 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1260 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:01.186754 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-316542b7-127a-414b-a6d3-f1a6dcbedb72 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:01.188620 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-316542b7-127a-414b-a6d3-f1a6dcbedb72 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:01.196539 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-316542b7-127a-414b-a6d3-f1a6dcbedb72 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:01.197385 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-316542b7-127a-414b-a6d3-f1a6dcbedb72 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:01.199036 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-316542b7-127a-414b-a6d3-f1a6dcbedb72 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:01.199892 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-316542b7-127a-414b-a6d3-f1a6dcbedb72 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:01.311767 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-316542b7-127a-414b-a6d3-f1a6dcbedb72 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 30779 microversion: 2.1 time: 0.127666 Nov 23 07:49:01.320627 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 428/827] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:49:01 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 30779 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:49:01.498320 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-2e30075f-adaa-498a-a812-a5f60046104d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:01.499716 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-2e30075f-adaa-498a-a812-a5f60046104d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:01.508580 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2e30075f-adaa-498a-a812-a5f60046104d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:01.509915 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2e30075f-adaa-498a-a812-a5f60046104d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:01.509915 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2e30075f-adaa-498a-a812-a5f60046104d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:01.510248 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2e30075f-adaa-498a-a812-a5f60046104d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:01.767030 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-2e30075f-adaa-498a-a812-a5f60046104d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:01.786902 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-2e30075f-adaa-498a-a812-a5f60046104d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:01.790247 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-2e30075f-adaa-498a-a812-a5f60046104d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:01.792409 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-2e30075f-adaa-498a-a812-a5f60046104d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1738 microversion: 2.20 time: 0.299573 Nov 23 07:49:01.793539 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 400/828] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:01 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1738 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:49:01.840039 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c1e3fc2f-9412-4caa-8a69-65109b88bf5c tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:01.841829 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c1e3fc2f-9412-4caa-8a69-65109b88bf5c tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:01.860771 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c1e3fc2f-9412-4caa-8a69-65109b88bf5c tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:01.862774 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c1e3fc2f-9412-4caa-8a69-65109b88bf5c tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:01.864651 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c1e3fc2f-9412-4caa-8a69-65109b88bf5c tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:01.865610 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c1e3fc2f-9412-4caa-8a69-65109b88bf5c tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:02.162556 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-c1e3fc2f-9412-4caa-8a69-65109b88bf5c tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:02.180241 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c1e3fc2f-9412-4caa-8a69-65109b88bf5c tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1260 microversion: 2.1 time: 0.347562 Nov 23 07:49:02.180834 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 429/829] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:01 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1260 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:02.336236 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-e4d50098-7cdb-48f8-b329-6d6dda3d1103 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:02.337217 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-e4d50098-7cdb-48f8-b329-6d6dda3d1103 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:02.346108 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e4d50098-7cdb-48f8-b329-6d6dda3d1103 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:02.346751 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e4d50098-7cdb-48f8-b329-6d6dda3d1103 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:02.347663 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e4d50098-7cdb-48f8-b329-6d6dda3d1103 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:02.348192 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e4d50098-7cdb-48f8-b329-6d6dda3d1103 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:02.457136 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-e4d50098-7cdb-48f8-b329-6d6dda3d1103 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 32278 microversion: 2.1 time: 0.126676 Nov 23 07:49:02.458245 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 401/830] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:49:02 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 32278 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:49:02.819349 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1f5a9dec-fefb-4b2e-8963-391d18e05800 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:02.820387 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1f5a9dec-fefb-4b2e-8963-391d18e05800 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:02.828328 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1f5a9dec-fefb-4b2e-8963-391d18e05800 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:02.828856 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1f5a9dec-fefb-4b2e-8963-391d18e05800 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:02.830397 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1f5a9dec-fefb-4b2e-8963-391d18e05800 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:02.831179 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1f5a9dec-fefb-4b2e-8963-391d18e05800 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:03.046788 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1f5a9dec-fefb-4b2e-8963-391d18e05800 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:03.103655 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1f5a9dec-fefb-4b2e-8963-391d18e05800 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:03.105796 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1f5a9dec-fefb-4b2e-8963-391d18e05800 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:03.107287 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1f5a9dec-fefb-4b2e-8963-391d18e05800 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1738 microversion: 2.20 time: 0.292103 Nov 23 07:49:03.118482 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 430/831] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:02 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1738 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:49:03.204297 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-192ed08e-6edd-4d9f-8685-2e6a8f640da4 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:03.205546 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-192ed08e-6edd-4d9f-8685-2e6a8f640da4 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:03.220116 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-3c23fb86-fe5e-49b7-b653-d4a390516cbf req-9d035698-4361-4f56-bc76-4b8aa66cb524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be38773-5840-4e15-b2f5-ce77caceb858", "name": "network-vif-plugged", "status": "completed", "tag": "a7bd6f41-4ac3-41e3-8d6f-dd2993595bc7"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:03.223420 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-192ed08e-6edd-4d9f-8685-2e6a8f640da4 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:03.224575 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-192ed08e-6edd-4d9f-8685-2e6a8f640da4 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:03.227152 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-192ed08e-6edd-4d9f-8685-2e6a8f640da4 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:03.228280 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-192ed08e-6edd-4d9f-8685-2e6a8f640da4 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:03.231970 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:49:03.231970 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:49:03.269891 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-3c23fb86-fe5e-49b7-b653-d4a390516cbf req-9d035698-4361-4f56-bc76-4b8aa66cb524 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:03.282900 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-3c23fb86-fe5e-49b7-b653-d4a390516cbf req-9d035698-4361-4f56-bc76-4b8aa66cb524 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:03.312231 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-3c23fb86-fe5e-49b7-b653-d4a390516cbf req-9d035698-4361-4f56-bc76-4b8aa66cb524 service nova] Creating event network-vif-plugged:a7bd6f41-4ac3-41e3-8d6f-dd2993595bc7 for instance 4be38773-5840-4e15-b2f5-ce77caceb858 on hv-cinder-80403 Nov 23 07:49:03.341289 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-3c23fb86-fe5e-49b7-b653-d4a390516cbf req-9d035698-4361-4f56-bc76-4b8aa66cb524 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125355 Nov 23 07:49:03.352957 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 431/832] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:49:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:49:03.482040 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6ac54e60-69fd-462a-9d95-6dc0ee9f098d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:03.484299 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6ac54e60-69fd-462a-9d95-6dc0ee9f098d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:03.498768 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6ac54e60-69fd-462a-9d95-6dc0ee9f098d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:03.500041 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6ac54e60-69fd-462a-9d95-6dc0ee9f098d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:03.503283 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6ac54e60-69fd-462a-9d95-6dc0ee9f098d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:03.504442 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6ac54e60-69fd-462a-9d95-6dc0ee9f098d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:03.552918 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-192ed08e-6edd-4d9f-8685-2e6a8f640da4 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:03.570817 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-192ed08e-6edd-4d9f-8685-2e6a8f640da4 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1260 microversion: 2.1 time: 0.372849 Nov 23 07:49:03.572419 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 402/833] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:03 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1260 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:03.643436 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6ac54e60-69fd-462a-9d95-6dc0ee9f098d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 33217 microversion: 2.1 time: 0.175284 Nov 23 07:49:03.651105 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 432/834] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:49:03 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 33217 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:49:04.129489 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-da0e066b-b1ad-4a25-afd4-aaaff58936a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:04.130597 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-da0e066b-b1ad-4a25-afd4-aaaff58936a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:04.141692 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-da0e066b-b1ad-4a25-afd4-aaaff58936a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:04.143005 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-da0e066b-b1ad-4a25-afd4-aaaff58936a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:04.144717 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-da0e066b-b1ad-4a25-afd4-aaaff58936a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:04.145450 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-da0e066b-b1ad-4a25-afd4-aaaff58936a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:04.305620 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-da0e066b-b1ad-4a25-afd4-aaaff58936a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:04.314254 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-da0e066b-b1ad-4a25-afd4-aaaff58936a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:04.315748 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-da0e066b-b1ad-4a25-afd4-aaaff58936a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:04.316942 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-da0e066b-b1ad-4a25-afd4-aaaff58936a0 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1738 microversion: 2.20 time: 0.194140 Nov 23 07:49:04.317512 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 403/835] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:04 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:49:04.591051 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-084efbb6-51f2-4869-ad6b-8bc3b7c5e043 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:04.591753 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-084efbb6-51f2-4869-ad6b-8bc3b7c5e043 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:04.599707 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-084efbb6-51f2-4869-ad6b-8bc3b7c5e043 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:04.600161 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-084efbb6-51f2-4869-ad6b-8bc3b7c5e043 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:04.600950 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-084efbb6-51f2-4869-ad6b-8bc3b7c5e043 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:04.601445 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-084efbb6-51f2-4869-ad6b-8bc3b7c5e043 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:04.657735 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-cd98bf00-1e9b-4774-899f-1407939bf1e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:04.659161 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-cd98bf00-1e9b-4774-899f-1407939bf1e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:04.665661 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cd98bf00-1e9b-4774-899f-1407939bf1e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:04.666183 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cd98bf00-1e9b-4774-899f-1407939bf1e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:04.666974 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cd98bf00-1e9b-4774-899f-1407939bf1e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:04.667413 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cd98bf00-1e9b-4774-899f-1407939bf1e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:04.738943 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-084efbb6-51f2-4869-ad6b-8bc3b7c5e043 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:04.746644 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-084efbb6-51f2-4869-ad6b-8bc3b7c5e043 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1260 microversion: 2.1 time: 0.159555 Nov 23 07:49:04.747249 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 433/836] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:04 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:04.764860 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-cd98bf00-1e9b-4774-899f-1407939bf1e2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 33690 microversion: 2.1 time: 0.110652 Nov 23 07:49:04.765520 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 404/837] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:49:04 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 33690 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:49:05.336139 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1859c660-2493-47ca-bdfd-8c4fbefc7f5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:05.336736 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1859c660-2493-47ca-bdfd-8c4fbefc7f5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:05.343506 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1859c660-2493-47ca-bdfd-8c4fbefc7f5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:05.343959 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1859c660-2493-47ca-bdfd-8c4fbefc7f5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:05.344745 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1859c660-2493-47ca-bdfd-8c4fbefc7f5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:05.345188 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1859c660-2493-47ca-bdfd-8c4fbefc7f5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:05.483220 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1859c660-2493-47ca-bdfd-8c4fbefc7f5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:05.498033 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1859c660-2493-47ca-bdfd-8c4fbefc7f5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:05.500945 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1859c660-2493-47ca-bdfd-8c4fbefc7f5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:05.503196 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1859c660-2493-47ca-bdfd-8c4fbefc7f5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1720 microversion: 2.20 time: 0.170594 Nov 23 07:49:05.504237 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 434/838] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:05 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:49:05.764309 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-eaab2086-dfdd-436b-bd79-4cecac60971a tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:05.765048 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-eaab2086-dfdd-436b-bd79-4cecac60971a tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:05.772528 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-eaab2086-dfdd-436b-bd79-4cecac60971a tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:05.772908 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-eaab2086-dfdd-436b-bd79-4cecac60971a tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:05.773683 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-eaab2086-dfdd-436b-bd79-4cecac60971a tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:05.774136 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-eaab2086-dfdd-436b-bd79-4cecac60971a tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:05.776027 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-116ba68c-1e35-4299-805f-23d4bd6a79e0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:05.776929 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-116ba68c-1e35-4299-805f-23d4bd6a79e0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:05.783760 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-116ba68c-1e35-4299-805f-23d4bd6a79e0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:05.784205 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-116ba68c-1e35-4299-805f-23d4bd6a79e0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:05.784977 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-116ba68c-1e35-4299-805f-23d4bd6a79e0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:05.786188 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-116ba68c-1e35-4299-805f-23d4bd6a79e0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:05.867108 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-116ba68c-1e35-4299-805f-23d4bd6a79e0 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 34383 microversion: 2.1 time: 0.094451 Nov 23 07:49:05.871155 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 435/839] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:49:05 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 34383 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:49:05.913629 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-eaab2086-dfdd-436b-bd79-4cecac60971a tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:05.921439 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-eaab2086-dfdd-436b-bd79-4cecac60971a tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1444 microversion: 2.1 time: 0.161094 Nov 23 07:49:05.922056 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 405/840] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:05 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:05.937938 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-2da22830-cf57-45cf-8814-b69b6c0b1916 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:05.938638 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-2da22830-cf57-45cf-8814-b69b6c0b1916 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:05.946132 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2da22830-cf57-45cf-8814-b69b6c0b1916 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:05.946577 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2da22830-cf57-45cf-8814-b69b6c0b1916 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:05.947359 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2da22830-cf57-45cf-8814-b69b6c0b1916 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:05.947793 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2da22830-cf57-45cf-8814-b69b6c0b1916 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:06.091510 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2da22830-cf57-45cf-8814-b69b6c0b1916 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:06.099610 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-2da22830-cf57-45cf-8814-b69b6c0b1916 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1444 microversion: 2.1 time: 0.165572 Nov 23 07:49:06.100187 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 436/841] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:05 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1444 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:06.469134 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3733a2a7-1e91-4a4c-8c7a-1ca69c3dcdb6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1211604685", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-592728128", "security_groups": [{"name": "tempest-secgroup-smoke-1517785560"}], "block_device_mapping_v2": [{"uuid": "6ed2a68d-991b-4e3e-9485-1ad2db494a54", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c4affbc5-6672-4357-8ba0-5a39b14c7726"}]}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:06.522092 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-60896ef4-5d27-4c53-b172-eb0a922f7287 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:06.522699 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-60896ef4-5d27-4c53-b172-eb0a922f7287 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:06.529811 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-60896ef4-5d27-4c53-b172-eb0a922f7287 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:06.530261 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-60896ef4-5d27-4c53-b172-eb0a922f7287 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:06.531057 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-60896ef4-5d27-4c53-b172-eb0a922f7287 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:06.531492 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-60896ef4-5d27-4c53-b172-eb0a922f7287 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:06.609802 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.network.neutron [None req-3733a2a7-1e91-4a4c-8c7a-1ca69c3dcdb6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] validate_networks() for [('c4affbc5-6672-4357-8ba0-5a39b14c7726', None, None, None, None, None)] {{(pid=122785) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:49:06.761677 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-60896ef4-5d27-4c53-b172-eb0a922f7287 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:06.777531 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-60896ef4-5d27-4c53-b172-eb0a922f7287 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:06.781980 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-60896ef4-5d27-4c53-b172-eb0a922f7287 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:06.783984 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-60896ef4-5d27-4c53-b172-eb0a922f7287 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1720 microversion: 2.20 time: 0.264910 Nov 23 07:49:06.784746 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 437/842] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:06 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1720 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:49:06.881164 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-503cd879-4239-4ba7-a0e6-54d26bce66f1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:06.882530 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-503cd879-4239-4ba7-a0e6-54d26bce66f1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:06.893580 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-503cd879-4239-4ba7-a0e6-54d26bce66f1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:06.893861 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-503cd879-4239-4ba7-a0e6-54d26bce66f1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:06.895386 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-503cd879-4239-4ba7-a0e6-54d26bce66f1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:06.896329 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-503cd879-4239-4ba7-a0e6-54d26bce66f1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:06.997774 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-503cd879-4239-4ba7-a0e6-54d26bce66f1 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 35306 microversion: 2.1 time: 0.121882 Nov 23 07:49:07.002550 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 438/843] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:49:06 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 35306 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:49:07.163507 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-3733a2a7-1e91-4a4c-8c7a-1ca69c3dcdb6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Flavor limits 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:49:07.164374 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-3733a2a7-1e91-4a4c-8c7a-1ca69c3dcdb6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Image limits 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:49:07.164650 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-3733a2a7-1e91-4a4c-8c7a-1ca69c3dcdb6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Flavor pref 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:49:07.164830 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-3733a2a7-1e91-4a4c-8c7a-1ca69c3dcdb6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Image pref 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:49:07.165218 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-3733a2a7-1e91-4a4c-8c7a-1ca69c3dcdb6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:49:07.175580 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3733a2a7-1e91-4a4c-8c7a-1ca69c3dcdb6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:07.176004 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3733a2a7-1e91-4a4c-8c7a-1ca69c3dcdb6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:07.176646 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3733a2a7-1e91-4a4c-8c7a-1ca69c3dcdb6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:07.177088 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3733a2a7-1e91-4a4c-8c7a-1ca69c3dcdb6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:07.195138 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-3733a2a7-1e91-4a4c-8c7a-1ca69c3dcdb6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Getting quotas for project 923ced17fbea41d2bb472b52dd316477. Resources: {'instances', 'cores', 'ram'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:49:07.199237 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-3733a2a7-1e91-4a4c-8c7a-1ca69c3dcdb6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Getting quotas for user cbb14b561f25411684be4c930e712800 and project 923ced17fbea41d2bb472b52dd316477. Resources: {'instances', 'cores', 'ram'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:49:07.277286 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3733a2a7-1e91-4a4c-8c7a-1ca69c3dcdb6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Going to run 1 instances... {{(pid=122785) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:49:07.279481 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3733a2a7-1e91-4a4c-8c7a-1ca69c3dcdb6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6ed2a68d-991b-4e3e-9485-1ad2db494a54',volume_size=None,volume_type=None)] {{(pid=122785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:49:07.464922 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3733a2a7-1e91-4a4c-8c7a-1ca69c3dcdb6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.999401 Nov 23 07:49:07.472112 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 406/844] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Nov 23 07:49:06 2021] POST /compute/v2.1/servers => generated 406 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 07:49:07.483256 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-f32f212c-2575-471e-8af1-03d06d96e83f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:07.484803 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f32f212c-2575-471e-8af1-03d06d96e83f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:07.587076 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-f32f212c-2575-471e-8af1-03d06d96e83f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:07.600174 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-f32f212c-2575-471e-8af1-03d06d96e83f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1094 microversion: 2.1 time: 0.125316 Nov 23 07:49:07.601471 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 439/845] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:07 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1094 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:07.821303 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-92137979-a197-45b2-82be-66c6024ae551 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:07.823463 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-92137979-a197-45b2-82be-66c6024ae551 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:07.838696 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-92137979-a197-45b2-82be-66c6024ae551 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:07.840046 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-92137979-a197-45b2-82be-66c6024ae551 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:07.842733 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-92137979-a197-45b2-82be-66c6024ae551 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:07.845615 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-92137979-a197-45b2-82be-66c6024ae551 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:08.019362 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8ba863d2-3fb2-4947-8d8f-48e3dd753b31 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:08.023610 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8ba863d2-3fb2-4947-8d8f-48e3dd753b31 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:08.045300 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8ba863d2-3fb2-4947-8d8f-48e3dd753b31 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:08.045788 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8ba863d2-3fb2-4947-8d8f-48e3dd753b31 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:08.047666 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8ba863d2-3fb2-4947-8d8f-48e3dd753b31 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:08.047666 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8ba863d2-3fb2-4947-8d8f-48e3dd753b31 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:08.121677 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-92137979-a197-45b2-82be-66c6024ae551 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:08.135254 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-8ba863d2-3fb2-4947-8d8f-48e3dd753b31 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 36665 microversion: 2.1 time: 0.123872 Nov 23 07:49:08.135569 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-92137979-a197-45b2-82be-66c6024ae551 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:08.136554 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 440/846] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:49:08 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 36665 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:49:08.137146 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-92137979-a197-45b2-82be-66c6024ae551 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:08.138499 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-92137979-a197-45b2-82be-66c6024ae551 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1663 microversion: 2.20 time: 0.326675 Nov 23 07:49:08.139075 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 407/847] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:07 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1663 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:49:08.157441 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-fe5dd58f-eac2-4a08-850b-d985b778ac7f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb594ce6-3ad4-46f9-b9e8-c036581465f7"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:08.159182 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-fe5dd58f-eac2-4a08-850b-d985b778ac7f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:08.167490 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fe5dd58f-eac2-4a08-850b-d985b778ac7f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:08.167868 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fe5dd58f-eac2-4a08-850b-d985b778ac7f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:08.168969 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fe5dd58f-eac2-4a08-850b-d985b778ac7f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:08.169402 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-fe5dd58f-eac2-4a08-850b-d985b778ac7f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:08.598426 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-fe5dd58f-eac2-4a08-850b-d985b778ac7f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.445200 Nov 23 07:49:08.599475 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 441/848] 10.222.0.48 () {62 vars in 1363 bytes} [Tue Nov 23 07:49:08 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/os-volume_attachments => generated 188 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:49:08.632441 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-caab9272-58e6-4960-952b-494264c8fc52 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:08.633583 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-caab9272-58e6-4960-952b-494264c8fc52 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:08.647320 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-caab9272-58e6-4960-952b-494264c8fc52 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:08.648989 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-caab9272-58e6-4960-952b-494264c8fc52 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:08.650732 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-caab9272-58e6-4960-952b-494264c8fc52 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:08.651799 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-caab9272-58e6-4960-952b-494264c8fc52 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:08.796404 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-caab9272-58e6-4960-952b-494264c8fc52 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:08.816638 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-caab9272-58e6-4960-952b-494264c8fc52 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1192 microversion: 2.1 time: 0.188290 Nov 23 07:49:08.819791 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 408/849] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:08 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1192 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:08.858974 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-aaa6aea6-a854-48ae-a692-e964a8c71053 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:08.860217 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-aaa6aea6-a854-48ae-a692-e964a8c71053 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:08.872035 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aaa6aea6-a854-48ae-a692-e964a8c71053 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:08.873038 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aaa6aea6-a854-48ae-a692-e964a8c71053 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:08.874865 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aaa6aea6-a854-48ae-a692-e964a8c71053 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:08.876274 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aaa6aea6-a854-48ae-a692-e964a8c71053 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:08.906478 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-da98bddf-69ce-417f-b3b3-49aa241d22da req-70e3a970-2353-4498-b5ab-3483b20a5edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be38773-5840-4e15-b2f5-ce77caceb858", "tag": "a7bd6f41-4ac3-41e3-8d6f-dd2993595bc7"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:08.910676 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:49:08.910676 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:49:08.922364 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-da98bddf-69ce-417f-b3b3-49aa241d22da req-70e3a970-2353-4498-b5ab-3483b20a5edd service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:08.923453 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-da98bddf-69ce-417f-b3b3-49aa241d22da req-70e3a970-2353-4498-b5ab-3483b20a5edd service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:08.945574 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-da98bddf-69ce-417f-b3b3-49aa241d22da req-70e3a970-2353-4498-b5ab-3483b20a5edd service nova] Creating event network-changed:a7bd6f41-4ac3-41e3-8d6f-dd2993595bc7 for instance 4be38773-5840-4e15-b2f5-ce77caceb858 on hv-cinder-80403 Nov 23 07:49:08.954369 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-da98bddf-69ce-417f-b3b3-49aa241d22da req-70e3a970-2353-4498-b5ab-3483b20a5edd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180378 Nov 23 07:49:08.958687 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 442/850] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:49:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:49:09.166777 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-0cef9aae-4a1e-4f40-b9a1-151672d18527 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:09.170737 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-0cef9aae-4a1e-4f40-b9a1-151672d18527 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:09.185191 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0cef9aae-4a1e-4f40-b9a1-151672d18527 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:09.186711 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0cef9aae-4a1e-4f40-b9a1-151672d18527 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:09.188477 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0cef9aae-4a1e-4f40-b9a1-151672d18527 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:09.190638 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0cef9aae-4a1e-4f40-b9a1-151672d18527 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:09.304881 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-0cef9aae-4a1e-4f40-b9a1-151672d18527 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 38071 microversion: 2.1 time: 0.154608 Nov 23 07:49:09.310952 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 443/851] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:49:09 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 38071 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:49:09.312632 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-e8468d30-d8c4-4c1d-8f57-e8ce83d780a4 req-563fe6a5-b72d-4c5e-b817-75b45a0bc6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d02284-ac69-4605-bd8e-1c29644f219c", "name": "network-vif-unplugged", "status": "completed", "tag": "7bb628ce-17b8-43a9-8265-270514936b86"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:09.316831 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:49:09.316831 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:49:09.337223 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-e8468d30-d8c4-4c1d-8f57-e8ce83d780a4 req-563fe6a5-b72d-4c5e-b817-75b45a0bc6d0 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:09.339492 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-e8468d30-d8c4-4c1d-8f57-e8ce83d780a4 req-563fe6a5-b72d-4c5e-b817-75b45a0bc6d0 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:09.393354 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-aaa6aea6-a854-48ae-a692-e964a8c71053 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "DELETE /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/os-volume_attachments/fb594ce6-3ad4-46f9-b9e8-c036581465f7" status: 202 len: 0 microversion: 2.20 time: 0.541065 Nov 23 07:49:09.415901 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.compute.server_external_events [req-e8468d30-d8c4-4c1d-8f57-e8ce83d780a4 req-563fe6a5-b72d-4c5e-b817-75b45a0bc6d0 service nova] Unable to find a host for instance 36d02284-ac69-4605-bd8e-1c29644f219c. Dropping event network-vif-unplugged {{(pid=122786) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 23 07:49:09.417540 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 409/852] 10.222.0.48 () {60 vars in 1456 bytes} [Tue Nov 23 07:49:08 2021] DELETE /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/os-volume_attachments/fb594ce6-3ad4-46f9-b9e8-c036581465f7 => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 23 07:49:09.418369 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-e8468d30-d8c4-4c1d-8f57-e8ce83d780a4 req-563fe6a5-b72d-4c5e-b817-75b45a0bc6d0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.111538 Nov 23 07:49:09.419819 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 444/853] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:49:09 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 114 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 23 07:49:09.474543 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-2c0b66ef-0145-4cc8-aa27-b8e572ad1be8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:09.475119 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-2c0b66ef-0145-4cc8-aa27-b8e572ad1be8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:09.481777 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2c0b66ef-0145-4cc8-aa27-b8e572ad1be8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:09.482199 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2c0b66ef-0145-4cc8-aa27-b8e572ad1be8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:09.483214 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2c0b66ef-0145-4cc8-aa27-b8e572ad1be8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:09.483888 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2c0b66ef-0145-4cc8-aa27-b8e572ad1be8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:09.648814 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-2c0b66ef-0145-4cc8-aa27-b8e572ad1be8 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action" status: 202 len: 0 microversion: 2.20 time: 0.178762 Nov 23 07:49:09.649897 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 410/854] 10.222.0.48 () {62 vars in 1318 bytes} [Tue Nov 23 07:49:09 2021] POST /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 07:49:09.659675 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-2979ca4d-f625-4855-85fe-9688afcaa516 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:09.660690 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-2979ca4d-f625-4855-85fe-9688afcaa516 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:09.672416 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2979ca4d-f625-4855-85fe-9688afcaa516 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:09.673506 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2979ca4d-f625-4855-85fe-9688afcaa516 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:09.679245 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2979ca4d-f625-4855-85fe-9688afcaa516 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:09.679713 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2979ca4d-f625-4855-85fe-9688afcaa516 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:09.846538 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-dee50eb5-a92d-4845-9fd2-b1df65071e1c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:09.848456 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-dee50eb5-a92d-4845-9fd2-b1df65071e1c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:09.856483 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-dee50eb5-a92d-4845-9fd2-b1df65071e1c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:09.857257 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-dee50eb5-a92d-4845-9fd2-b1df65071e1c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:09.858723 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-dee50eb5-a92d-4845-9fd2-b1df65071e1c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:09.859376 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-dee50eb5-a92d-4845-9fd2-b1df65071e1c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:09.948614 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2979ca4d-f625-4855-85fe-9688afcaa516 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:09.962874 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2979ca4d-f625-4855-85fe-9688afcaa516 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:09.968030 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2979ca4d-f625-4855-85fe-9688afcaa516 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:09.973844 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-2979ca4d-f625-4855-85fe-9688afcaa516 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1671 microversion: 2.20 time: 0.318709 Nov 23 07:49:09.975624 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 445/855] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:09 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1671 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:49:10.019711 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-dee50eb5-a92d-4845-9fd2-b1df65071e1c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:10.041156 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-dee50eb5-a92d-4845-9fd2-b1df65071e1c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1198 microversion: 2.1 time: 0.198122 Nov 23 07:49:10.042651 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 411/856] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:09 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1198 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:49:10.327429 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c835df2d-5a66-4fe7-9808-b7857a519a18 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:10.328467 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c835df2d-5a66-4fe7-9808-b7857a519a18 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:10.337352 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c835df2d-5a66-4fe7-9808-b7857a519a18 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:10.338159 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c835df2d-5a66-4fe7-9808-b7857a519a18 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:10.338974 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c835df2d-5a66-4fe7-9808-b7857a519a18 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:10.339416 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c835df2d-5a66-4fe7-9808-b7857a519a18 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:10.448061 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c835df2d-5a66-4fe7-9808-b7857a519a18 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 38177 microversion: 2.1 time: 0.128096 Nov 23 07:49:10.452139 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 446/857] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:49:10 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 38177 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:49:11.004612 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-46954f9a-48ff-49f2-b3e9-71a1b3fa50f1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:11.005220 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-46954f9a-48ff-49f2-b3e9-71a1b3fa50f1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:11.015498 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-46954f9a-48ff-49f2-b3e9-71a1b3fa50f1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:11.015983 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-46954f9a-48ff-49f2-b3e9-71a1b3fa50f1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:11.016986 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-46954f9a-48ff-49f2-b3e9-71a1b3fa50f1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:11.017659 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-46954f9a-48ff-49f2-b3e9-71a1b3fa50f1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:11.064794 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-cfe2ac7c-3f2e-43ca-819e-fae693da4e50 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:11.065502 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-cfe2ac7c-3f2e-43ca-819e-fae693da4e50 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:11.072674 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cfe2ac7c-3f2e-43ca-819e-fae693da4e50 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:11.073129 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cfe2ac7c-3f2e-43ca-819e-fae693da4e50 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:11.073956 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cfe2ac7c-3f2e-43ca-819e-fae693da4e50 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:11.074395 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cfe2ac7c-3f2e-43ca-819e-fae693da4e50 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:11.238513 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-cfe2ac7c-3f2e-43ca-819e-fae693da4e50 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:11.246381 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-cfe2ac7c-3f2e-43ca-819e-fae693da4e50 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.186061 Nov 23 07:49:11.246970 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 447/858] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:11 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:49:11.430887 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-46954f9a-48ff-49f2-b3e9-71a1b3fa50f1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:11.439449 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-46954f9a-48ff-49f2-b3e9-71a1b3fa50f1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:11.441789 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-46954f9a-48ff-49f2-b3e9-71a1b3fa50f1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:11.443174 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-46954f9a-48ff-49f2-b3e9-71a1b3fa50f1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1729 microversion: 2.20 time: 0.443116 Nov 23 07:49:11.443745 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 412/859] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:10 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1729 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:49:11.462686 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-3fa07fb8-8a73-40d0-be46-7d5958dc6243 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:11.463596 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-3fa07fb8-8a73-40d0-be46-7d5958dc6243 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:11.470235 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3fa07fb8-8a73-40d0-be46-7d5958dc6243 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:11.471245 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3fa07fb8-8a73-40d0-be46-7d5958dc6243 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:11.472046 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3fa07fb8-8a73-40d0-be46-7d5958dc6243 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:11.472481 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3fa07fb8-8a73-40d0-be46-7d5958dc6243 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:11.544215 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-3fa07fb8-8a73-40d0-be46-7d5958dc6243 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 38177 microversion: 2.1 time: 0.084507 Nov 23 07:49:11.546309 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 448/860] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:49:11 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 38177 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 07:49:12.029382 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-4d4cda70-77cc-4f31-bfb5-846382ca8f5c req-826998ac-79bb-415c-831b-f522df3d096a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e6c04f8-01f0-44e2-9232-f865f1af5591", "tag": "89fe006c-5309-4d1a-9597-f6755351dfd8"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:12.031369 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:49:12.031369 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:49:12.046350 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-4d4cda70-77cc-4f31-bfb5-846382ca8f5c req-826998ac-79bb-415c-831b-f522df3d096a service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:12.047193 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-4d4cda70-77cc-4f31-bfb5-846382ca8f5c req-826998ac-79bb-415c-831b-f522df3d096a service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:12.072511 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-4d4cda70-77cc-4f31-bfb5-846382ca8f5c req-826998ac-79bb-415c-831b-f522df3d096a service nova] Creating event network-changed:89fe006c-5309-4d1a-9597-f6755351dfd8 for instance 9e6c04f8-01f0-44e2-9232-f865f1af5591 on hv-cinder-80403 Nov 23 07:49:12.078935 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-4d4cda70-77cc-4f31-bfb5-846382ca8f5c req-826998ac-79bb-415c-831b-f522df3d096a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054960 Nov 23 07:49:12.080572 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 413/861] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:49:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:49:12.264893 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8797bba3-cebd-46c7-a825-674784625e6f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:12.265677 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8797bba3-cebd-46c7-a825-674784625e6f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:12.273600 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8797bba3-cebd-46c7-a825-674784625e6f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:12.274516 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8797bba3-cebd-46c7-a825-674784625e6f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:12.275735 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8797bba3-cebd-46c7-a825-674784625e6f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:12.276509 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8797bba3-cebd-46c7-a825-674784625e6f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:12.463607 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-facb6e0e-c273-46e8-a817-5dce80d43ab5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:12.464890 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-facb6e0e-c273-46e8-a817-5dce80d43ab5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:12.471735 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-facb6e0e-c273-46e8-a817-5dce80d43ab5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:12.472540 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-facb6e0e-c273-46e8-a817-5dce80d43ab5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:12.473552 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-facb6e0e-c273-46e8-a817-5dce80d43ab5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:12.474395 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-facb6e0e-c273-46e8-a817-5dce80d43ab5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:12.505028 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-8797bba3-cebd-46c7-a825-674784625e6f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:12.526976 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-8797bba3-cebd-46c7-a825-674784625e6f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.260899 Nov 23 07:49:12.528691 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 449/862] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:12 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:12.559315 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d391cda0-9ea0-4518-adb8-4e96e24106ec tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:12.560242 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d391cda0-9ea0-4518-adb8-4e96e24106ec tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:12.567697 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d391cda0-9ea0-4518-adb8-4e96e24106ec tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:12.568375 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d391cda0-9ea0-4518-adb8-4e96e24106ec tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:12.569054 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d391cda0-9ea0-4518-adb8-4e96e24106ec tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:12.569799 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d391cda0-9ea0-4518-adb8-4e96e24106ec tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:12.650584 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d391cda0-9ea0-4518-adb8-4e96e24106ec tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 38177 microversion: 2.1 time: 0.093856 Nov 23 07:49:12.654132 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 450/863] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:49:12 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 38177 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:49:12.746323 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-facb6e0e-c273-46e8-a817-5dce80d43ab5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:12.763807 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-facb6e0e-c273-46e8-a817-5dce80d43ab5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:12.765417 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-facb6e0e-c273-46e8-a817-5dce80d43ab5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:12.766767 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-facb6e0e-c273-46e8-a817-5dce80d43ab5 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1729 microversion: 2.20 time: 0.308333 Nov 23 07:49:12.773759 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 414/864] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:12 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1729 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:49:13.549458 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-41c2fae8-bca1-4108-acf5-3572b74c26c6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:13.550936 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-41c2fae8-bca1-4108-acf5-3572b74c26c6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:13.559188 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-41c2fae8-bca1-4108-acf5-3572b74c26c6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:13.559661 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-41c2fae8-bca1-4108-acf5-3572b74c26c6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:13.560540 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-41c2fae8-bca1-4108-acf5-3572b74c26c6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:13.561006 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-41c2fae8-bca1-4108-acf5-3572b74c26c6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:13.667095 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5e5f47b4-73e8-4508-ae45-979ad7f1372b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:13.668653 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5e5f47b4-73e8-4508-ae45-979ad7f1372b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:13.683241 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5e5f47b4-73e8-4508-ae45-979ad7f1372b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:13.684129 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5e5f47b4-73e8-4508-ae45-979ad7f1372b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:13.686053 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5e5f47b4-73e8-4508-ae45-979ad7f1372b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:13.686931 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5e5f47b4-73e8-4508-ae45-979ad7f1372b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:13.769478 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-41c2fae8-bca1-4108-acf5-3572b74c26c6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:13.777959 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-41c2fae8-bca1-4108-acf5-3572b74c26c6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.234739 Nov 23 07:49:13.778547 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 451/865] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:13 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:13.785954 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-776ee0f8-ce7f-482a-afa1-1678e9a9ee5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:13.786617 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-776ee0f8-ce7f-482a-afa1-1678e9a9ee5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:13.796162 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-776ee0f8-ce7f-482a-afa1-1678e9a9ee5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:13.796754 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-776ee0f8-ce7f-482a-afa1-1678e9a9ee5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:13.797790 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-776ee0f8-ce7f-482a-afa1-1678e9a9ee5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:13.798335 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-776ee0f8-ce7f-482a-afa1-1678e9a9ee5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:13.995046 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-776ee0f8-ce7f-482a-afa1-1678e9a9ee5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:14.004497 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-776ee0f8-ce7f-482a-afa1-1678e9a9ee5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:14.006323 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-776ee0f8-ce7f-482a-afa1-1678e9a9ee5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:14.007557 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-776ee0f8-ce7f-482a-afa1-1678e9a9ee5d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1729 microversion: 2.20 time: 0.225980 Nov 23 07:49:14.008286 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 452/866] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:13 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:49:14.797860 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6adb877d-f83d-483b-86b6-db3a8264f668 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:14.798729 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6adb877d-f83d-483b-86b6-db3a8264f668 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:14.807651 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6adb877d-f83d-483b-86b6-db3a8264f668 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:14.808432 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6adb877d-f83d-483b-86b6-db3a8264f668 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:14.809905 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6adb877d-f83d-483b-86b6-db3a8264f668 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:14.810683 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6adb877d-f83d-483b-86b6-db3a8264f668 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:14.992498 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6adb877d-f83d-483b-86b6-db3a8264f668 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:15.000738 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6adb877d-f83d-483b-86b6-db3a8264f668 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.207381 Nov 23 07:49:15.001323 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 453/867] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:14 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:49:15.031695 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-109c5234-5047-4417-ad4e-cd9f80071db1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:15.033910 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-109c5234-5047-4417-ad4e-cd9f80071db1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:15.045484 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-109c5234-5047-4417-ad4e-cd9f80071db1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:15.046329 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-109c5234-5047-4417-ad4e-cd9f80071db1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:15.047823 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-109c5234-5047-4417-ad4e-cd9f80071db1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:15.049235 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-109c5234-5047-4417-ad4e-cd9f80071db1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:15.242098 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-109c5234-5047-4417-ad4e-cd9f80071db1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:15.250476 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-109c5234-5047-4417-ad4e-cd9f80071db1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:15.252061 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-109c5234-5047-4417-ad4e-cd9f80071db1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:15.253266 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-109c5234-5047-4417-ad4e-cd9f80071db1 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1729 microversion: 2.20 time: 0.228967 Nov 23 07:49:15.253866 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 454/868] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:15 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1729 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:49:16.020531 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c891881e-b80f-479d-bc0b-4ed9cabc0d28 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:16.021210 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c891881e-b80f-479d-bc0b-4ed9cabc0d28 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:16.029075 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c891881e-b80f-479d-bc0b-4ed9cabc0d28 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:16.029869 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c891881e-b80f-479d-bc0b-4ed9cabc0d28 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:16.031415 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c891881e-b80f-479d-bc0b-4ed9cabc0d28 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:16.032211 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c891881e-b80f-479d-bc0b-4ed9cabc0d28 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:16.190480 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-c891881e-b80f-479d-bc0b-4ed9cabc0d28 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:16.203912 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c891881e-b80f-479d-bc0b-4ed9cabc0d28 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.188345 Nov 23 07:49:16.205525 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 455/869] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:16 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:49:16.282295 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-5711fca5-0bc2-471b-b049-2bdb691a662f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:16.283155 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-5711fca5-0bc2-471b-b049-2bdb691a662f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:16.290175 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5711fca5-0bc2-471b-b049-2bdb691a662f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:16.290729 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5711fca5-0bc2-471b-b049-2bdb691a662f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:16.291671 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5711fca5-0bc2-471b-b049-2bdb691a662f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:16.292276 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5711fca5-0bc2-471b-b049-2bdb691a662f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:16.511284 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5711fca5-0bc2-471b-b049-2bdb691a662f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:16.520205 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5711fca5-0bc2-471b-b049-2bdb691a662f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:16.521775 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5711fca5-0bc2-471b-b049-2bdb691a662f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:16.523188 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-5711fca5-0bc2-471b-b049-2bdb691a662f tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1729 microversion: 2.20 time: 0.244560 Nov 23 07:49:16.525850 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 456/870] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:16 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1729 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:49:17.223188 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b5160b40-2706-4cab-9bc5-03d4153ff556 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:17.223870 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-b5160b40-2706-4cab-9bc5-03d4153ff556 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:17.235093 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b5160b40-2706-4cab-9bc5-03d4153ff556 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:17.235562 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b5160b40-2706-4cab-9bc5-03d4153ff556 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:17.236948 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b5160b40-2706-4cab-9bc5-03d4153ff556 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:17.237388 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b5160b40-2706-4cab-9bc5-03d4153ff556 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:17.428988 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b5160b40-2706-4cab-9bc5-03d4153ff556 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:17.439993 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b5160b40-2706-4cab-9bc5-03d4153ff556 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.220838 Nov 23 07:49:17.441104 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 457/871] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:17 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:17.542678 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-58eb9058-e497-4630-9961-f535e8febb1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:17.543332 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-58eb9058-e497-4630-9961-f535e8febb1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:17.550687 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-58eb9058-e497-4630-9961-f535e8febb1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:17.551137 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-58eb9058-e497-4630-9961-f535e8febb1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:17.551947 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-58eb9058-e497-4630-9961-f535e8febb1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:17.552389 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-58eb9058-e497-4630-9961-f535e8febb1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:17.721661 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-58eb9058-e497-4630-9961-f535e8febb1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:17.737177 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-58eb9058-e497-4630-9961-f535e8febb1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:17.740787 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-58eb9058-e497-4630-9961-f535e8febb1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:17.743513 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-58eb9058-e497-4630-9961-f535e8febb1c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1729 microversion: 2.20 time: 0.204573 Nov 23 07:49:17.744803 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 458/872] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:17 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:49:18.458491 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-de67b76c-a882-4259-ad87-8354d3bdfccc tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:18.459212 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-de67b76c-a882-4259-ad87-8354d3bdfccc tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:18.466241 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-de67b76c-a882-4259-ad87-8354d3bdfccc tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:18.466696 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-de67b76c-a882-4259-ad87-8354d3bdfccc tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:18.467487 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-de67b76c-a882-4259-ad87-8354d3bdfccc tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:18.467926 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-de67b76c-a882-4259-ad87-8354d3bdfccc tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:18.616714 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-de67b76c-a882-4259-ad87-8354d3bdfccc tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:18.631512 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-de67b76c-a882-4259-ad87-8354d3bdfccc tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.177026 Nov 23 07:49:18.632225 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 459/873] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:18 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:49:18.764912 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-76461836-7b17-4e08-b635-a71840becf6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:18.765572 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-76461836-7b17-4e08-b635-a71840becf6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:18.775490 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-76461836-7b17-4e08-b635-a71840becf6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:18.776485 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-76461836-7b17-4e08-b635-a71840becf6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:18.777745 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-76461836-7b17-4e08-b635-a71840becf6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:18.778416 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-76461836-7b17-4e08-b635-a71840becf6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:18.958670 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-76461836-7b17-4e08-b635-a71840becf6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:18.966713 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-76461836-7b17-4e08-b635-a71840becf6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:18.968197 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-76461836-7b17-4e08-b635-a71840becf6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:18.969344 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-76461836-7b17-4e08-b635-a71840becf6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1729 microversion: 2.20 time: 0.208964 Nov 23 07:49:18.969931 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 460/874] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:18 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:49:19.650952 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ea318b83-6c7c-47eb-b3fe-978f6fc6f328 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:19.652537 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ea318b83-6c7c-47eb-b3fe-978f6fc6f328 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:19.659441 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea318b83-6c7c-47eb-b3fe-978f6fc6f328 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:19.659898 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea318b83-6c7c-47eb-b3fe-978f6fc6f328 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:19.660963 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea318b83-6c7c-47eb-b3fe-978f6fc6f328 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:19.661407 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea318b83-6c7c-47eb-b3fe-978f6fc6f328 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:19.845840 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ea318b83-6c7c-47eb-b3fe-978f6fc6f328 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:19.855641 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ea318b83-6c7c-47eb-b3fe-978f6fc6f328 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.208217 Nov 23 07:49:19.856725 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 461/875] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:19 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:49:19.988536 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-3f92a6d1-93a5-496f-acfd-d894446f69c7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:19.989138 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-3f92a6d1-93a5-496f-acfd-d894446f69c7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:19.995287 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3f92a6d1-93a5-496f-acfd-d894446f69c7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:19.995728 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3f92a6d1-93a5-496f-acfd-d894446f69c7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:19.996519 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3f92a6d1-93a5-496f-acfd-d894446f69c7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:19.996950 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3f92a6d1-93a5-496f-acfd-d894446f69c7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:20.155039 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-3f92a6d1-93a5-496f-acfd-d894446f69c7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:20.163967 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-3f92a6d1-93a5-496f-acfd-d894446f69c7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:20.165464 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-3f92a6d1-93a5-496f-acfd-d894446f69c7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:20.166684 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-3f92a6d1-93a5-496f-acfd-d894446f69c7 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1729 microversion: 2.20 time: 0.182395 Nov 23 07:49:20.167243 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 462/876] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:19 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:49:20.875345 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-48c277f4-7733-44a8-b37f-772a5fab58d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:20.876945 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-48c277f4-7733-44a8-b37f-772a5fab58d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:20.883698 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-48c277f4-7733-44a8-b37f-772a5fab58d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:20.884987 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-48c277f4-7733-44a8-b37f-772a5fab58d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:20.885512 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-48c277f4-7733-44a8-b37f-772a5fab58d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:20.885883 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-48c277f4-7733-44a8-b37f-772a5fab58d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:21.075631 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-48c277f4-7733-44a8-b37f-772a5fab58d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:21.084847 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-48c277f4-7733-44a8-b37f-772a5fab58d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.212971 Nov 23 07:49:21.085660 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 463/877] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:20 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:21.186691 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6a5c1aed-56b6-4f28-83ff-99b692bf9a1d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:21.187472 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6a5c1aed-56b6-4f28-83ff-99b692bf9a1d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:21.193907 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6a5c1aed-56b6-4f28-83ff-99b692bf9a1d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:21.194494 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6a5c1aed-56b6-4f28-83ff-99b692bf9a1d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:21.195443 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6a5c1aed-56b6-4f28-83ff-99b692bf9a1d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:21.195949 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6a5c1aed-56b6-4f28-83ff-99b692bf9a1d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:21.370024 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6a5c1aed-56b6-4f28-83ff-99b692bf9a1d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:21.379467 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6a5c1aed-56b6-4f28-83ff-99b692bf9a1d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:21.381060 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6a5c1aed-56b6-4f28-83ff-99b692bf9a1d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:21.382325 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6a5c1aed-56b6-4f28-83ff-99b692bf9a1d tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1729 microversion: 2.20 time: 0.200237 Nov 23 07:49:21.382903 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 464/878] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:21 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:49:22.103696 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-7bce9c11-85df-483d-98f7-f881603d136f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:22.104462 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-7bce9c11-85df-483d-98f7-f881603d136f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:22.111540 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7bce9c11-85df-483d-98f7-f881603d136f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:22.111997 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7bce9c11-85df-483d-98f7-f881603d136f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:22.112811 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7bce9c11-85df-483d-98f7-f881603d136f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:22.113256 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7bce9c11-85df-483d-98f7-f881603d136f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:22.272166 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-7bce9c11-85df-483d-98f7-f881603d136f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:22.285750 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-7bce9c11-85df-483d-98f7-f881603d136f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.185338 Nov 23 07:49:22.286780 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 465/879] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:22 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:49:22.402810 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-779c46ea-87ca-41cd-a15a-5d0df8bcdc84 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:22.403334 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-779c46ea-87ca-41cd-a15a-5d0df8bcdc84 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:22.409573 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-779c46ea-87ca-41cd-a15a-5d0df8bcdc84 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:22.410050 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-779c46ea-87ca-41cd-a15a-5d0df8bcdc84 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:22.411094 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-779c46ea-87ca-41cd-a15a-5d0df8bcdc84 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:22.411531 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-779c46ea-87ca-41cd-a15a-5d0df8bcdc84 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:22.568700 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-779c46ea-87ca-41cd-a15a-5d0df8bcdc84 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:22.577056 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-779c46ea-87ca-41cd-a15a-5d0df8bcdc84 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:22.578616 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-779c46ea-87ca-41cd-a15a-5d0df8bcdc84 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:22.580397 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-779c46ea-87ca-41cd-a15a-5d0df8bcdc84 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1729 microversion: 2.20 time: 0.181007 Nov 23 07:49:22.580962 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 466/880] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:22 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:49:23.307621 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a221ba2f-9c72-44db-b907-04f8982f8985 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:23.308449 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a221ba2f-9c72-44db-b907-04f8982f8985 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:23.316587 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a221ba2f-9c72-44db-b907-04f8982f8985 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:23.317170 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a221ba2f-9c72-44db-b907-04f8982f8985 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:23.317986 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a221ba2f-9c72-44db-b907-04f8982f8985 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:23.318415 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a221ba2f-9c72-44db-b907-04f8982f8985 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:23.477642 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a221ba2f-9c72-44db-b907-04f8982f8985 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:23.489932 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a221ba2f-9c72-44db-b907-04f8982f8985 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.187240 Nov 23 07:49:23.490620 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 467/881] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:23 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:49:23.608061 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b460eda4-7040-4131-9644-b8b6a8dcebc9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:23.609168 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-b460eda4-7040-4131-9644-b8b6a8dcebc9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:23.620436 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b460eda4-7040-4131-9644-b8b6a8dcebc9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:23.621230 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b460eda4-7040-4131-9644-b8b6a8dcebc9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:23.622716 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b460eda4-7040-4131-9644-b8b6a8dcebc9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:23.623494 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b460eda4-7040-4131-9644-b8b6a8dcebc9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:23.846127 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b460eda4-7040-4131-9644-b8b6a8dcebc9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:23.854941 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b460eda4-7040-4131-9644-b8b6a8dcebc9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:23.856483 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b460eda4-7040-4131-9644-b8b6a8dcebc9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:23.857675 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b460eda4-7040-4131-9644-b8b6a8dcebc9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1729 microversion: 2.20 time: 0.256865 Nov 23 07:49:23.858289 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 468/882] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:23 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1729 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:49:24.440984 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5e5f47b4-73e8-4508-ae45-979ad7f1372b tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action" status: 200 len: 38308 microversion: 2.1 time: 10.777688 Nov 23 07:49:24.441914 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 415/883] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:49:13 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/action => generated 38308 bytes in 10781 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 07:49:24.452322 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-37cc19b3-53ff-4cff-8f0f-740a8f87cfb7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:24.453109 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-37cc19b3-53ff-4cff-8f0f-740a8f87cfb7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:24.459877 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-37cc19b3-53ff-4cff-8f0f-740a8f87cfb7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:24.460331 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-37cc19b3-53ff-4cff-8f0f-740a8f87cfb7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:24.461141 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-37cc19b3-53ff-4cff-8f0f-740a8f87cfb7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:24.461840 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-37cc19b3-53ff-4cff-8f0f-740a8f87cfb7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:24.491308 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-37cc19b3-53ff-4cff-8f0f-740a8f87cfb7 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/ips" status: 200 len: 147 microversion: 2.1 time: 0.042797 Nov 23 07:49:24.491901 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 469/884] 10.222.0.48 () {58 vars in 1247 bytes} [Tue Nov 23 07:49:24 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/ips => generated 147 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:49:24.510957 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f1b9eb65-5830-4ae8-a09d-46a3464a0a00 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:24.511669 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f1b9eb65-5830-4ae8-a09d-46a3464a0a00 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:24.524766 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f1b9eb65-5830-4ae8-a09d-46a3464a0a00 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:24.525743 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f1b9eb65-5830-4ae8-a09d-46a3464a0a00 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:24.527202 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f1b9eb65-5830-4ae8-a09d-46a3464a0a00 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:24.527960 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f1b9eb65-5830-4ae8-a09d-46a3464a0a00 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:24.880596 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f1b9eb65-5830-4ae8-a09d-46a3464a0a00 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:24.881943 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ee6aac58-4236-430b-8a57-526504133593 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:24.885197 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ee6aac58-4236-430b-8a57-526504133593 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:24.896779 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ee6aac58-4236-430b-8a57-526504133593 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:24.898005 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ee6aac58-4236-430b-8a57-526504133593 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:24.899767 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ee6aac58-4236-430b-8a57-526504133593 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:24.900829 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ee6aac58-4236-430b-8a57-526504133593 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:24.901957 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f1b9eb65-5830-4ae8-a09d-46a3464a0a00 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.394961 Nov 23 07:49:24.904078 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 416/885] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:24 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:25.063599 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ee6aac58-4236-430b-8a57-526504133593 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:25.072843 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ee6aac58-4236-430b-8a57-526504133593 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:25.074434 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ee6aac58-4236-430b-8a57-526504133593 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:25.075840 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ee6aac58-4236-430b-8a57-526504133593 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1729 microversion: 2.20 time: 0.202153 Nov 23 07:49:25.076413 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 470/886] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:24 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:49:25.930056 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ac0077ad-76cf-459f-bf3c-06607d6cc2ec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:25.931105 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ac0077ad-76cf-459f-bf3c-06607d6cc2ec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:25.941565 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ac0077ad-76cf-459f-bf3c-06607d6cc2ec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:25.942352 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ac0077ad-76cf-459f-bf3c-06607d6cc2ec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:25.943745 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ac0077ad-76cf-459f-bf3c-06607d6cc2ec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:25.944514 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ac0077ad-76cf-459f-bf3c-06607d6cc2ec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:25.969239 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4463a040-2c34-4887-8873-aa8d98728343 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd0dfa1f-77db-4581-8cfb-f7da2594e8e7"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:25.971533 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4463a040-2c34-4887-8873-aa8d98728343 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:25.979965 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4463a040-2c34-4887-8873-aa8d98728343 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:25.980492 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4463a040-2c34-4887-8873-aa8d98728343 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:25.981397 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4463a040-2c34-4887-8873-aa8d98728343 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:25.981948 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4463a040-2c34-4887-8873-aa8d98728343 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:26.137357 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ac0077ad-76cf-459f-bf3c-06607d6cc2ec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:26.145248 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ac0077ad-76cf-459f-bf3c-06607d6cc2ec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.221699 Nov 23 07:49:26.145848 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 417/887] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:25 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:26.150486 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c581ba00-319c-4458-8d2e-ef90e147a675 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:26.151160 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c581ba00-319c-4458-8d2e-ef90e147a675 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:26.158357 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c581ba00-319c-4458-8d2e-ef90e147a675 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:26.158756 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c581ba00-319c-4458-8d2e-ef90e147a675 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:26.159817 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c581ba00-319c-4458-8d2e-ef90e147a675 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:26.160504 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c581ba00-319c-4458-8d2e-ef90e147a675 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:26.335037 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4463a040-2c34-4887-8873-aa8d98728343 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.369653 Nov 23 07:49:26.336051 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 471/888] 10.222.0.48 () {60 vars in 1322 bytes} [Tue Nov 23 07:49:25 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:49:26.341070 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c581ba00-319c-4458-8d2e-ef90e147a675 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:26.351652 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c581ba00-319c-4458-8d2e-ef90e147a675 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:26.353489 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c581ba00-319c-4458-8d2e-ef90e147a675 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:26.354836 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c581ba00-319c-4458-8d2e-ef90e147a675 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1729 microversion: 2.20 time: 0.208015 Nov 23 07:49:26.355405 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 418/889] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:26 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:49:27.165438 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-562f1ce1-44cc-43fe-be3b-5fbafa0537e4 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:27.166615 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-562f1ce1-44cc-43fe-be3b-5fbafa0537e4 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:27.175560 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-562f1ce1-44cc-43fe-be3b-5fbafa0537e4 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:27.176208 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-562f1ce1-44cc-43fe-be3b-5fbafa0537e4 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:27.177155 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-562f1ce1-44cc-43fe-be3b-5fbafa0537e4 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:27.177730 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-562f1ce1-44cc-43fe-be3b-5fbafa0537e4 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:27.358492 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-562f1ce1-44cc-43fe-be3b-5fbafa0537e4 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:27.367620 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-562f1ce1-44cc-43fe-be3b-5fbafa0537e4 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.207828 Nov 23 07:49:27.368206 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 472/890] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:27 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:49:27.392362 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-6c5d466c-469e-493b-9720-b17de39e2adb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:27.392990 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-6c5d466c-469e-493b-9720-b17de39e2adb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:27.399759 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6c5d466c-469e-493b-9720-b17de39e2adb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:27.400254 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6c5d466c-469e-493b-9720-b17de39e2adb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:27.401207 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6c5d466c-469e-493b-9720-b17de39e2adb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:27.401782 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6c5d466c-469e-493b-9720-b17de39e2adb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:27.573089 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-6c5d466c-469e-493b-9720-b17de39e2adb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:27.587968 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-6c5d466c-469e-493b-9720-b17de39e2adb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:27.591285 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-6c5d466c-469e-493b-9720-b17de39e2adb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:27.593534 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-6c5d466c-469e-493b-9720-b17de39e2adb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1729 microversion: 2.20 time: 0.204711 Nov 23 07:49:27.594617 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 419/891] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:27 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:49:28.385925 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-9408c205-6c9d-4079-90e0-2b36b8d82ef0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:28.386523 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-9408c205-6c9d-4079-90e0-2b36b8d82ef0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:28.393615 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9408c205-6c9d-4079-90e0-2b36b8d82ef0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:28.394110 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9408c205-6c9d-4079-90e0-2b36b8d82ef0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:28.395000 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9408c205-6c9d-4079-90e0-2b36b8d82ef0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:28.395499 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9408c205-6c9d-4079-90e0-2b36b8d82ef0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:28.555606 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-9408c205-6c9d-4079-90e0-2b36b8d82ef0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:28.569523 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-9408c205-6c9d-4079-90e0-2b36b8d82ef0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.186987 Nov 23 07:49:28.570664 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 473/892] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:28 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:28.614768 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-a1ec9ba0-fc36-4b56-870a-f1624afa1f58 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:28.615536 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-a1ec9ba0-fc36-4b56-870a-f1624afa1f58 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:28.623246 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a1ec9ba0-fc36-4b56-870a-f1624afa1f58 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:28.623689 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a1ec9ba0-fc36-4b56-870a-f1624afa1f58 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:28.624481 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a1ec9ba0-fc36-4b56-870a-f1624afa1f58 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:28.624916 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a1ec9ba0-fc36-4b56-870a-f1624afa1f58 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:28.784795 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a1ec9ba0-fc36-4b56-870a-f1624afa1f58 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:28.798743 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a1ec9ba0-fc36-4b56-870a-f1624afa1f58 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:28.800702 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a1ec9ba0-fc36-4b56-870a-f1624afa1f58 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:28.801938 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-a1ec9ba0-fc36-4b56-870a-f1624afa1f58 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1729 microversion: 2.20 time: 0.191992 Nov 23 07:49:28.802530 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 420/893] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:28 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:49:29.187764 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-3b58c1b8-e562-4e6e-9530-1d46d8f800f2 req-9860fb5a-ebca-4ec2-9515-51c22a1e1a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d02284-ac69-4605-bd8e-1c29644f219c", "name": "network-vif-plugged", "status": "completed", "tag": "7bb628ce-17b8-43a9-8265-270514936b86"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:29.189564 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:49:29.189564 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:49:29.197641 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-3b58c1b8-e562-4e6e-9530-1d46d8f800f2 req-9860fb5a-ebca-4ec2-9515-51c22a1e1a50 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:29.198257 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-3b58c1b8-e562-4e6e-9530-1d46d8f800f2 req-9860fb5a-ebca-4ec2-9515-51c22a1e1a50 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:29.210592 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-3b58c1b8-e562-4e6e-9530-1d46d8f800f2 req-9860fb5a-ebca-4ec2-9515-51c22a1e1a50 service nova] Creating event network-vif-plugged:7bb628ce-17b8-43a9-8265-270514936b86 for instance 36d02284-ac69-4605-bd8e-1c29644f219c on hv-cinder-80403 Nov 23 07:49:29.215662 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-3b58c1b8-e562-4e6e-9530-1d46d8f800f2 req-9860fb5a-ebca-4ec2-9515-51c22a1e1a50 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031843 Nov 23 07:49:29.216262 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 474/894] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:49:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:49:29.588437 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-a7ac561d-9ad3-4717-a5c2-526b00a71638 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:29.589212 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-a7ac561d-9ad3-4717-a5c2-526b00a71638 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:29.597050 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a7ac561d-9ad3-4717-a5c2-526b00a71638 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:29.597050 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a7ac561d-9ad3-4717-a5c2-526b00a71638 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:29.597681 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a7ac561d-9ad3-4717-a5c2-526b00a71638 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:29.598160 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-a7ac561d-9ad3-4717-a5c2-526b00a71638 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:29.741519 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-a7ac561d-9ad3-4717-a5c2-526b00a71638 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:29.749363 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-a7ac561d-9ad3-4717-a5c2-526b00a71638 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.165068 Nov 23 07:49:29.749996 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 421/895] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:29 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:29.835321 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-56568662-00e7-4d08-93d4-002875b169c9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:29.836222 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-56568662-00e7-4d08-93d4-002875b169c9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:29.845609 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-56568662-00e7-4d08-93d4-002875b169c9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:29.846160 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-56568662-00e7-4d08-93d4-002875b169c9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:29.847172 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-56568662-00e7-4d08-93d4-002875b169c9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:29.847611 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-56568662-00e7-4d08-93d4-002875b169c9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:30.013465 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-56568662-00e7-4d08-93d4-002875b169c9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:30.022202 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-56568662-00e7-4d08-93d4-002875b169c9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:30.023862 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-56568662-00e7-4d08-93d4-002875b169c9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:30.024920 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-56568662-00e7-4d08-93d4-002875b169c9 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1729 microversion: 2.20 time: 0.195967 Nov 23 07:49:30.025526 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 475/896] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:29 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:49:30.771292 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-33c831e3-8646-4137-a07d-5aeb647bc9d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:30.772400 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-33c831e3-8646-4137-a07d-5aeb647bc9d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:30.783420 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-33c831e3-8646-4137-a07d-5aeb647bc9d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:30.784450 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-33c831e3-8646-4137-a07d-5aeb647bc9d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:30.786367 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-33c831e3-8646-4137-a07d-5aeb647bc9d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:30.787141 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-33c831e3-8646-4137-a07d-5aeb647bc9d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:30.990439 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-33c831e3-8646-4137-a07d-5aeb647bc9d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:31.004693 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-33c831e3-8646-4137-a07d-5aeb647bc9d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.240690 Nov 23 07:49:31.005306 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 422/897] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:30 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:31.046018 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-259a1631-1ce2-4498-8e77-73d8007c0c60 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:31.050955 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-259a1631-1ce2-4498-8e77-73d8007c0c60 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:31.064769 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-259a1631-1ce2-4498-8e77-73d8007c0c60 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:31.065505 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-259a1631-1ce2-4498-8e77-73d8007c0c60 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:31.066875 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-259a1631-1ce2-4498-8e77-73d8007c0c60 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:31.067587 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-259a1631-1ce2-4498-8e77-73d8007c0c60 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:31.262883 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-259a1631-1ce2-4498-8e77-73d8007c0c60 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:31.271857 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-259a1631-1ce2-4498-8e77-73d8007c0c60 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:31.273634 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-259a1631-1ce2-4498-8e77-73d8007c0c60 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:31.275083 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-259a1631-1ce2-4498-8e77-73d8007c0c60 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1729 microversion: 2.20 time: 0.234412 Nov 23 07:49:31.275664 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 476/898] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:31 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:49:32.022897 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-cb9bbff5-bbcd-49a2-8240-deadc3096aec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:32.023563 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-cb9bbff5-bbcd-49a2-8240-deadc3096aec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:32.030749 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cb9bbff5-bbcd-49a2-8240-deadc3096aec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:32.031370 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cb9bbff5-bbcd-49a2-8240-deadc3096aec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:32.032287 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cb9bbff5-bbcd-49a2-8240-deadc3096aec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:32.033341 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-cb9bbff5-bbcd-49a2-8240-deadc3096aec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:32.187518 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-cb9bbff5-bbcd-49a2-8240-deadc3096aec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:32.202171 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-cb9bbff5-bbcd-49a2-8240-deadc3096aec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.183038 Nov 23 07:49:32.202970 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 423/899] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:32 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:49:32.294406 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c5c1aa6b-ac6e-4f4f-a3da-dfbfc417c7aa tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:32.295260 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c5c1aa6b-ac6e-4f4f-a3da-dfbfc417c7aa tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:32.302685 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c5c1aa6b-ac6e-4f4f-a3da-dfbfc417c7aa tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:32.303380 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c5c1aa6b-ac6e-4f4f-a3da-dfbfc417c7aa tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:32.304568 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c5c1aa6b-ac6e-4f4f-a3da-dfbfc417c7aa tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:32.305104 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c5c1aa6b-ac6e-4f4f-a3da-dfbfc417c7aa tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:32.455565 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-c5c1aa6b-ac6e-4f4f-a3da-dfbfc417c7aa tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:32.463992 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-c5c1aa6b-ac6e-4f4f-a3da-dfbfc417c7aa tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:32.465491 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-c5c1aa6b-ac6e-4f4f-a3da-dfbfc417c7aa tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:32.466697 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c5c1aa6b-ac6e-4f4f-a3da-dfbfc417c7aa tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1716 microversion: 2.20 time: 0.176238 Nov 23 07:49:32.467265 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 477/900] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:49:32 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1716 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:49:32.831193 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-745676a3-7cb2-46d0-9631-335c0ccd8b26 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:32.832107 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-745676a3-7cb2-46d0-9631-335c0ccd8b26 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:32.837947 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-745676a3-7cb2-46d0-9631-335c0ccd8b26 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:32.838389 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-745676a3-7cb2-46d0-9631-335c0ccd8b26 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:32.839157 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-745676a3-7cb2-46d0-9631-335c0ccd8b26 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:32.839584 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-745676a3-7cb2-46d0-9631-335c0ccd8b26 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:32.869356 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-745676a3-7cb2-46d0-9631-335c0ccd8b26 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042392 Nov 23 07:49:32.869862 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 424/901] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:49:32 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:49:32.879935 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-06702ed4-a21d-4af1-a008-d1d3d3a076ac tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:32.880425 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-06702ed4-a21d-4af1-a008-d1d3d3a076ac tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:32.886688 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-06702ed4-a21d-4af1-a008-d1d3d3a076ac tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:32.887137 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-06702ed4-a21d-4af1-a008-d1d3d3a076ac tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:32.887960 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-06702ed4-a21d-4af1-a008-d1d3d3a076ac tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:32.888381 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-06702ed4-a21d-4af1-a008-d1d3d3a076ac tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:32.917597 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-06702ed4-a21d-4af1-a008-d1d3d3a076ac tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments/cd0dfa1f-77db-4581-8cfb-f7da2594e8e7" status: 200 len: 194 microversion: 2.1 time: 0.041904 Nov 23 07:49:32.918216 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 478/902] 10.222.0.48 () {58 vars in 1412 bytes} [Tue Nov 23 07:49:32 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments/cd0dfa1f-77db-4581-8cfb-f7da2594e8e7 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:49:33.222213 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-44a0b6df-acdd-4f00-9730-aa0b6d3875ed tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:33.222904 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-44a0b6df-acdd-4f00-9730-aa0b6d3875ed tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:33.229316 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-44a0b6df-acdd-4f00-9730-aa0b6d3875ed tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:33.229902 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-44a0b6df-acdd-4f00-9730-aa0b6d3875ed tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:33.230691 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-44a0b6df-acdd-4f00-9730-aa0b6d3875ed tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:33.231104 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-44a0b6df-acdd-4f00-9730-aa0b6d3875ed tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:33.363192 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-44a0b6df-acdd-4f00-9730-aa0b6d3875ed tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:33.371334 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-44a0b6df-acdd-4f00-9730-aa0b6d3875ed tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.153136 Nov 23 07:49:33.371853 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 425/903] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:33 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:34.243976 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c10f78b3-2139-4b3e-b6f9-54ea16431e39 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b7fecce-7017-421a-9361-dcf3847fcb0d"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:34.245111 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c10f78b3-2139-4b3e-b6f9-54ea16431e39 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:34.251702 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c10f78b3-2139-4b3e-b6f9-54ea16431e39 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:34.252141 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c10f78b3-2139-4b3e-b6f9-54ea16431e39 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:34.252920 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c10f78b3-2139-4b3e-b6f9-54ea16431e39 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:34.253344 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c10f78b3-2139-4b3e-b6f9-54ea16431e39 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:34.396543 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c0eba749-4a91-4a85-867e-5f9a302fbd22 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:34.397733 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c0eba749-4a91-4a85-867e-5f9a302fbd22 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:34.404228 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c0eba749-4a91-4a85-867e-5f9a302fbd22 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:34.404724 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c0eba749-4a91-4a85-867e-5f9a302fbd22 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:34.405539 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c0eba749-4a91-4a85-867e-5f9a302fbd22 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:34.406058 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c0eba749-4a91-4a85-867e-5f9a302fbd22 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:34.514634 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c10f78b3-2139-4b3e-b6f9-54ea16431e39 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274223 Nov 23 07:49:34.515285 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 479/904] 10.222.0.48 () {60 vars in 1322 bytes} [Tue Nov 23 07:49:34 2021] POST /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:49:34.560258 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c0eba749-4a91-4a85-867e-5f9a302fbd22 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:34.569028 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c0eba749-4a91-4a85-867e-5f9a302fbd22 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.176443 Nov 23 07:49:34.569479 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 426/905] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:34 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:49:35.204101 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-b7f0a145-d3a2-42b8-87c0-911209a68f5e req-9fcaee61-7113-4b26-8884-1ffca9e4d65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e6c04f8-01f0-44e2-9232-f865f1af5591", "name": "network-vif-plugged", "status": "completed", "tag": "89fe006c-5309-4d1a-9597-f6755351dfd8"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:35.205894 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:49:35.205894 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:49:35.213316 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-b7f0a145-d3a2-42b8-87c0-911209a68f5e req-9fcaee61-7113-4b26-8884-1ffca9e4d65b service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:35.213787 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-b7f0a145-d3a2-42b8-87c0-911209a68f5e req-9fcaee61-7113-4b26-8884-1ffca9e4d65b service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:35.228291 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-b7f0a145-d3a2-42b8-87c0-911209a68f5e req-9fcaee61-7113-4b26-8884-1ffca9e4d65b service nova] Creating event network-vif-plugged:89fe006c-5309-4d1a-9597-f6755351dfd8 for instance 9e6c04f8-01f0-44e2-9232-f865f1af5591 on hv-cinder-80403 Nov 23 07:49:35.233418 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-b7f0a145-d3a2-42b8-87c0-911209a68f5e req-9fcaee61-7113-4b26-8884-1ffca9e4d65b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033942 Nov 23 07:49:35.234142 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 480/906] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:49:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:49:35.590895 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-42760361-041e-48b2-87fc-2ca202040f1a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:35.592068 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-42760361-041e-48b2-87fc-2ca202040f1a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:35.599927 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-42760361-041e-48b2-87fc-2ca202040f1a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:35.600562 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-42760361-041e-48b2-87fc-2ca202040f1a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:35.601562 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-42760361-041e-48b2-87fc-2ca202040f1a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:35.602096 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-42760361-041e-48b2-87fc-2ca202040f1a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:35.749270 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-42760361-041e-48b2-87fc-2ca202040f1a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:35.757051 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-42760361-041e-48b2-87fc-2ca202040f1a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1266 microversion: 2.1 time: 0.170625 Nov 23 07:49:35.757653 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 427/907] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:35 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:36.779058 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-92b97e34-b220-473d-9342-3ab6a530e9e2 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:36.780247 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-92b97e34-b220-473d-9342-3ab6a530e9e2 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:36.790763 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-92b97e34-b220-473d-9342-3ab6a530e9e2 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:36.791332 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-92b97e34-b220-473d-9342-3ab6a530e9e2 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:36.792235 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-92b97e34-b220-473d-9342-3ab6a530e9e2 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:36.794613 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-92b97e34-b220-473d-9342-3ab6a530e9e2 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:36.957973 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-92b97e34-b220-473d-9342-3ab6a530e9e2 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:36.966892 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-92b97e34-b220-473d-9342-3ab6a530e9e2 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1453 microversion: 2.1 time: 0.195400 Nov 23 07:49:36.967467 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 481/908] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:36 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1453 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:36.988197 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-13d64070-4b97-4b82-bd98-48e3feccccc6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:36.989346 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-13d64070-4b97-4b82-bd98-48e3feccccc6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:36.996323 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13d64070-4b97-4b82-bd98-48e3feccccc6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:36.996912 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13d64070-4b97-4b82-bd98-48e3feccccc6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:36.997875 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13d64070-4b97-4b82-bd98-48e3feccccc6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:36.998347 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-13d64070-4b97-4b82-bd98-48e3feccccc6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:37.154390 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-13d64070-4b97-4b82-bd98-48e3feccccc6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:37.162707 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-13d64070-4b97-4b82-bd98-48e3feccccc6 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1453 microversion: 2.1 time: 0.182153 Nov 23 07:49:37.163276 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 428/909] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:36 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1453 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:38.846803 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-7845435d-a8d9-4f3b-ba31-f30559c4abb1 req-fcff2625-cd10-4fd5-9e9a-bd2331c306f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e6c04f8-01f0-44e2-9232-f865f1af5591", "tag": "89fe006c-5309-4d1a-9597-f6755351dfd8"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:38.848308 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:49:38.848308 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:49:38.856369 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-7845435d-a8d9-4f3b-ba31-f30559c4abb1 req-fcff2625-cd10-4fd5-9e9a-bd2331c306f7 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:38.856812 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-7845435d-a8d9-4f3b-ba31-f30559c4abb1 req-fcff2625-cd10-4fd5-9e9a-bd2331c306f7 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:38.868630 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-7845435d-a8d9-4f3b-ba31-f30559c4abb1 req-fcff2625-cd10-4fd5-9e9a-bd2331c306f7 service nova] Creating event network-changed:89fe006c-5309-4d1a-9597-f6755351dfd8 for instance 9e6c04f8-01f0-44e2-9232-f865f1af5591 on hv-cinder-80403 Nov 23 07:49:38.874746 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-7845435d-a8d9-4f3b-ba31-f30559c4abb1 req-fcff2625-cd10-4fd5-9e9a-bd2331c306f7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031236 Nov 23 07:49:38.875347 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 482/910] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:49:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:49:42.029572 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-4234eaea-0548-492b-9a02-f8c0bdb6441d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:42.030937 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-4234eaea-0548-492b-9a02-f8c0bdb6441d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:42.038130 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4234eaea-0548-492b-9a02-f8c0bdb6441d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:42.038575 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4234eaea-0548-492b-9a02-f8c0bdb6441d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:42.039411 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4234eaea-0548-492b-9a02-f8c0bdb6441d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:42.039891 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4234eaea-0548-492b-9a02-f8c0bdb6441d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:42.074380 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-4234eaea-0548-492b-9a02-f8c0bdb6441d tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049665 Nov 23 07:49:42.074999 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 429/911] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:49:42 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:49:42.351443 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-853b4d36-d2bb-4b6e-90e3-40434e35b868 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:42.352022 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-853b4d36-d2bb-4b6e-90e3-40434e35b868 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:42.358309 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-853b4d36-d2bb-4b6e-90e3-40434e35b868 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:42.366407 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-853b4d36-d2bb-4b6e-90e3-40434e35b868 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:42.366407 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-853b4d36-d2bb-4b6e-90e3-40434e35b868 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:42.366407 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-853b4d36-d2bb-4b6e-90e3-40434e35b868 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:42.396155 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-853b4d36-d2bb-4b6e-90e3-40434e35b868 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments/cd0dfa1f-77db-4581-8cfb-f7da2594e8e7" status: 200 len: 194 microversion: 2.1 time: 0.049249 Nov 23 07:49:42.396766 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 483/912] 10.222.0.48 () {58 vars in 1412 bytes} [Tue Nov 23 07:49:42 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments/cd0dfa1f-77db-4581-8cfb-f7da2594e8e7 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:49:42.408230 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3a7e877a-a6e5-46d6-9fc4-d7bad1fe8fab tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:42.408714 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3a7e877a-a6e5-46d6-9fc4-d7bad1fe8fab tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:42.415009 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3a7e877a-a6e5-46d6-9fc4-d7bad1fe8fab tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:42.415446 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3a7e877a-a6e5-46d6-9fc4-d7bad1fe8fab tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:42.416213 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3a7e877a-a6e5-46d6-9fc4-d7bad1fe8fab tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:42.416923 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3a7e877a-a6e5-46d6-9fc4-d7bad1fe8fab tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:42.505201 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.objects.instance [None req-3a7e877a-a6e5-46d6-9fc4-d7bad1fe8fab tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lazy-loading 'services' on Instance uuid 65836c81-3d98-4338-a51d-aa3bb0ef7b76 {{(pid=122785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:49:42.577037 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3a7e877a-a6e5-46d6-9fc4-d7bad1fe8fab tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "DELETE /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments/cd0dfa1f-77db-4581-8cfb-f7da2594e8e7" status: 202 len: 0 microversion: 2.1 time: 0.173095 Nov 23 07:49:42.577943 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 430/913] 10.222.0.48 () {58 vars in 1415 bytes} [Tue Nov 23 07:49:42 2021] DELETE /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments/cd0dfa1f-77db-4581-8cfb-f7da2594e8e7 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:49:44.753061 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d56f8632-410d-48ef-ad52-9b0cd7ae3e6e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:44.753684 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d56f8632-410d-48ef-ad52-9b0cd7ae3e6e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:44.760132 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d56f8632-410d-48ef-ad52-9b0cd7ae3e6e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:44.760647 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d56f8632-410d-48ef-ad52-9b0cd7ae3e6e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:44.761490 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d56f8632-410d-48ef-ad52-9b0cd7ae3e6e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:44.762001 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d56f8632-410d-48ef-ad52-9b0cd7ae3e6e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:44.796269 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d56f8632-410d-48ef-ad52-9b0cd7ae3e6e tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments/6b7fecce-7017-421a-9361-dcf3847fcb0d" status: 200 len: 194 microversion: 2.1 time: 0.049517 Nov 23 07:49:44.796896 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 484/914] 10.222.0.48 () {58 vars in 1412 bytes} [Tue Nov 23 07:49:44 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments/6b7fecce-7017-421a-9361-dcf3847fcb0d => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:49:44.808159 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ab5d6dff-65dc-4beb-96e9-e2487e4ed2a5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:44.808880 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ab5d6dff-65dc-4beb-96e9-e2487e4ed2a5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:44.818071 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ab5d6dff-65dc-4beb-96e9-e2487e4ed2a5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:44.818566 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ab5d6dff-65dc-4beb-96e9-e2487e4ed2a5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:44.819785 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ab5d6dff-65dc-4beb-96e9-e2487e4ed2a5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:44.820372 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ab5d6dff-65dc-4beb-96e9-e2487e4ed2a5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:44.934452 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.objects.instance [None req-ab5d6dff-65dc-4beb-96e9-e2487e4ed2a5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lazy-loading 'services' on Instance uuid 65836c81-3d98-4338-a51d-aa3bb0ef7b76 {{(pid=122785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:49:45.032453 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ab5d6dff-65dc-4beb-96e9-e2487e4ed2a5 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "DELETE /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments/6b7fecce-7017-421a-9361-dcf3847fcb0d" status: 202 len: 0 microversion: 2.1 time: 0.228428 Nov 23 07:49:45.033618 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 431/915] 10.222.0.48 () {58 vars in 1415 bytes} [Tue Nov 23 07:49:44 2021] DELETE /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments/6b7fecce-7017-421a-9361-dcf3847fcb0d => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:49:46.252285 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-67456bb2-a63e-4ee1-a734-d8ac10a67d08 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:46.254021 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-67456bb2-a63e-4ee1-a734-d8ac10a67d08 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:46.266149 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-67456bb2-a63e-4ee1-a734-d8ac10a67d08 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:46.267540 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-67456bb2-a63e-4ee1-a734-d8ac10a67d08 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:46.269091 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-67456bb2-a63e-4ee1-a734-d8ac10a67d08 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:46.269918 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-67456bb2-a63e-4ee1-a734-d8ac10a67d08 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:46.326528 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-67456bb2-a63e-4ee1-a734-d8ac10a67d08 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081732 Nov 23 07:49:46.327240 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 485/916] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:49:46 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:49:46.462484 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-abc8d978-9f39-48e7-8dfe-468dd27df7a2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:46.463712 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-abc8d978-9f39-48e7-8dfe-468dd27df7a2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:46.474285 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-abc8d978-9f39-48e7-8dfe-468dd27df7a2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:46.475071 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-abc8d978-9f39-48e7-8dfe-468dd27df7a2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:46.476486 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-abc8d978-9f39-48e7-8dfe-468dd27df7a2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:46.477672 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-abc8d978-9f39-48e7-8dfe-468dd27df7a2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:46.530402 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-abc8d978-9f39-48e7-8dfe-468dd27df7a2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073148 Nov 23 07:49:46.531013 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 432/917] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:49:46 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:49:46.592847 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e804500e-7a34-4604-b599-c0a1afc55555 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:46.593338 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e804500e-7a34-4604-b599-c0a1afc55555 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:46.599698 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e804500e-7a34-4604-b599-c0a1afc55555 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:46.600153 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e804500e-7a34-4604-b599-c0a1afc55555 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:46.600947 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e804500e-7a34-4604-b599-c0a1afc55555 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:46.601407 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e804500e-7a34-4604-b599-c0a1afc55555 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:46.630800 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e804500e-7a34-4604-b599-c0a1afc55555 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Going to try to terminate instance {{(pid=122786) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:49:46.717327 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e804500e-7a34-4604-b599-c0a1afc55555 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "DELETE /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76" status: 204 len: 0 microversion: 2.1 time: 0.128153 Nov 23 07:49:46.717885 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 486/918] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:49:46 2021] DELETE /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 07:49:46.726960 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-04df2f3f-9085-46f9-a0ae-4e5887462da2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:46.727629 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-04df2f3f-9085-46f9-a0ae-4e5887462da2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:46.734756 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-04df2f3f-9085-46f9-a0ae-4e5887462da2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:46.736311 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-04df2f3f-9085-46f9-a0ae-4e5887462da2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:46.737111 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-04df2f3f-9085-46f9-a0ae-4e5887462da2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:46.737543 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-04df2f3f-9085-46f9-a0ae-4e5887462da2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:46.881688 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-04df2f3f-9085-46f9-a0ae-4e5887462da2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:46.890313 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-04df2f3f-9085-46f9-a0ae-4e5887462da2 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76" status: 200 len: 1674 microversion: 2.1 time: 0.167475 Nov 23 07:49:46.890917 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 433/919] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:46 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:49:47.908808 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-9c5153ac-0566-410c-bfa1-620d51b7759a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:47.909543 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-9c5153ac-0566-410c-bfa1-620d51b7759a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:47.916372 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9c5153ac-0566-410c-bfa1-620d51b7759a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:47.916888 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9c5153ac-0566-410c-bfa1-620d51b7759a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:47.917680 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9c5153ac-0566-410c-bfa1-620d51b7759a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:47.918137 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9c5153ac-0566-410c-bfa1-620d51b7759a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:48.056761 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-9c5153ac-0566-410c-bfa1-620d51b7759a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:48.064898 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-9c5153ac-0566-410c-bfa1-620d51b7759a tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76" status: 200 len: 1674 microversion: 2.1 time: 0.160165 Nov 23 07:49:48.068058 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 487/920] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:47 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:49:49.084494 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-4aa47322-c257-4757-9199-77c8567f260f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:49.085058 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-4aa47322-c257-4757-9199-77c8567f260f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:49.092496 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4aa47322-c257-4757-9199-77c8567f260f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:49.093020 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4aa47322-c257-4757-9199-77c8567f260f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:49.094128 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4aa47322-c257-4757-9199-77c8567f260f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:49.095326 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4aa47322-c257-4757-9199-77c8567f260f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:49.494149 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-4aa47322-c257-4757-9199-77c8567f260f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:49.502053 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-4aa47322-c257-4757-9199-77c8567f260f tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76" status: 200 len: 1674 microversion: 2.1 time: 0.423797 Nov 23 07:49:49.502731 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 434/921] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:49 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76 => generated 1674 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:49:50.057040 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-25334fab-c92b-42c2-97b5-dd4be63ff0e7 req-1005e3c5-146d-432b-8f12-7ee4c6013a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65836c81-3d98-4338-a51d-aa3bb0ef7b76", "name": "network-vif-deleted", "tag": "57edcc25-5f03-4d06-8e19-80459dbc84fb"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:49:50.060192 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:49:50.060192 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:49:50.074915 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-25334fab-c92b-42c2-97b5-dd4be63ff0e7 req-1005e3c5-146d-432b-8f12-7ee4c6013a27 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:50.075586 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-25334fab-c92b-42c2-97b5-dd4be63ff0e7 req-1005e3c5-146d-432b-8f12-7ee4c6013a27 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:50.091977 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-25334fab-c92b-42c2-97b5-dd4be63ff0e7 req-1005e3c5-146d-432b-8f12-7ee4c6013a27 service nova] Creating event network-vif-deleted:57edcc25-5f03-4d06-8e19-80459dbc84fb for instance 65836c81-3d98-4338-a51d-aa3bb0ef7b76 on hv-cinder-80403 Nov 23 07:49:50.098730 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-25334fab-c92b-42c2-97b5-dd4be63ff0e7 req-1005e3c5-146d-432b-8f12-7ee4c6013a27 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058523 Nov 23 07:49:50.099784 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 488/922] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:49:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:49:50.519517 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ed748f5f-9192-4a3b-a2e3-842632752ce8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:50.520064 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ed748f5f-9192-4a3b-a2e3-842632752ce8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:50.526835 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ed748f5f-9192-4a3b-a2e3-842632752ce8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:50.527279 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ed748f5f-9192-4a3b-a2e3-842632752ce8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:50.528081 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ed748f5f-9192-4a3b-a2e3-842632752ce8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:50.528503 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ed748f5f-9192-4a3b-a2e3-842632752ce8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:50.567228 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ed748f5f-9192-4a3b-a2e3-842632752ce8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:50.567676 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ed748f5f-9192-4a3b-a2e3-842632752ce8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:50.568133 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.objects.instance [None req-ed748f5f-9192-4a3b-a2e3-842632752ce8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lazy-loading 'fault' on Instance uuid 65836c81-3d98-4338-a51d-aa3bb0ef7b76 {{(pid=122785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:49:50.617201 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ed748f5f-9192-4a3b-a2e3-842632752ce8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a88554481924707acaf2afd81d18793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7f91007a2a4b90b80701592589a131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:49:50.628177 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ed748f5f-9192-4a3b-a2e3-842632752ce8 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76" status: 200 len: 1327 microversion: 2.1 time: 0.111711 Nov 23 07:49:50.630320 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 435/923] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:50 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76 => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:49:51.653740 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-55fa9323-d5a1-4175-b099-606bb1aa2520 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:51.654374 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-55fa9323-d5a1-4175-b099-606bb1aa2520 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:51.661148 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-55fa9323-d5a1-4175-b099-606bb1aa2520 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:51.661598 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-55fa9323-d5a1-4175-b099-606bb1aa2520 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:51.662438 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-55fa9323-d5a1-4175-b099-606bb1aa2520 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:51.662874 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-55fa9323-d5a1-4175-b099-606bb1aa2520 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:51.677332 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-55fa9323-d5a1-4175-b099-606bb1aa2520 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] HTTP exception thrown: Instance 65836c81-3d98-4338-a51d-aa3bb0ef7b76 could not be found. Nov 23 07:49:51.678283 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-55fa9323-d5a1-4175-b099-606bb1aa2520 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Returning 404 to user: Instance 65836c81-3d98-4338-a51d-aa3bb0ef7b76 could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:49:51.679693 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-55fa9323-d5a1-4175-b099-606bb1aa2520 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76" status: 404 len: 111 microversion: 2.1 time: 0.030629 Nov 23 07:49:51.680639 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 489/924] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:51 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:49:51.690524 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-8ef13b20-3b43-4c8b-bf7c-5b92137ba9eb tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '.version_select at 0x7f0507fccf70>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:51.709880 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-8ef13b20-3b43-4c8b-bf7c-5b92137ba9eb tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-528478556" status: 202 len: 0 microversion: 2.1 time: 0.023287 Nov 23 07:49:51.710752 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 436/925] 10.222.0.48 () {58 vars in 1217 bytes} [Tue Nov 23 07:49:51 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-528478556 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:49:54.660828 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-70c30a17-eaf4-491f-8ab2-12f49bf728d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:54.661775 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-70c30a17-eaf4-491f-8ab2-12f49bf728d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:54.669311 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-70c30a17-eaf4-491f-8ab2-12f49bf728d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:54.669909 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-70c30a17-eaf4-491f-8ab2-12f49bf728d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:54.670815 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-70c30a17-eaf4-491f-8ab2-12f49bf728d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:54.671271 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-70c30a17-eaf4-491f-8ab2-12f49bf728d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:54.687498 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-70c30a17-eaf4-491f-8ab2-12f49bf728d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] HTTP exception thrown: Instance 65836c81-3d98-4338-a51d-aa3bb0ef7b76 could not be found. Nov 23 07:49:54.688313 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-70c30a17-eaf4-491f-8ab2-12f49bf728d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Returning 404 to user: Instance 65836c81-3d98-4338-a51d-aa3bb0ef7b76 could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:49:54.689255 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-70c30a17-eaf4-491f-8ab2-12f49bf728d6 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "DELETE /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76" status: 404 len: 111 microversion: 2.1 time: 0.033337 Nov 23 07:49:54.690005 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 490/926] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:49:54 2021] DELETE /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:49:54.702084 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3deaba9f-8404-43b4-9184-b7a3d6659915 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:54.702997 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3deaba9f-8404-43b4-9184-b7a3d6659915 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 65836c81-3d98-4338-a51d-aa3bb0ef7b76] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:54.711956 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3deaba9f-8404-43b4-9184-b7a3d6659915 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:54.712475 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3deaba9f-8404-43b4-9184-b7a3d6659915 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:54.713273 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3deaba9f-8404-43b4-9184-b7a3d6659915 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:54.713759 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3deaba9f-8404-43b4-9184-b7a3d6659915 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:54.737985 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-3deaba9f-8404-43b4-9184-b7a3d6659915 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] HTTP exception thrown: Instance 65836c81-3d98-4338-a51d-aa3bb0ef7b76 could not be found. Nov 23 07:49:54.738600 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3deaba9f-8404-43b4-9184-b7a3d6659915 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Returning 404 to user: Instance 65836c81-3d98-4338-a51d-aa3bb0ef7b76 could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:49:54.739476 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3deaba9f-8404-43b4-9184-b7a3d6659915 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76" status: 404 len: 111 microversion: 2.1 time: 0.044718 Nov 23 07:49:54.740068 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 437/927] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:54 2021] GET /compute/v2.1/servers/65836c81-3d98-4338-a51d-aa3bb0ef7b76 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:49:55.926531 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-7ffaf6ee-6331-42db-b1e2-f6e4e5a81861 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:55.927156 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-7ffaf6ee-6331-42db-b1e2-f6e4e5a81861 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:55.934515 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7ffaf6ee-6331-42db-b1e2-f6e4e5a81861 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:55.935108 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7ffaf6ee-6331-42db-b1e2-f6e4e5a81861 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:55.936003 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7ffaf6ee-6331-42db-b1e2-f6e4e5a81861 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:55.936624 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7ffaf6ee-6331-42db-b1e2-f6e4e5a81861 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:55.952459 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-7ffaf6ee-6331-42db-b1e2-f6e4e5a81861 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] HTTP exception thrown: Instance 28c2d383-cc82-4479-b0fe-d92e63ef538d could not be found. Nov 23 07:49:55.953094 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-7ffaf6ee-6331-42db-b1e2-f6e4e5a81861 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Returning 404 to user: Instance 28c2d383-cc82-4479-b0fe-d92e63ef538d could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:49:55.954517 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-7ffaf6ee-6331-42db-b1e2-f6e4e5a81861 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "DELETE /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 404 len: 111 microversion: 2.1 time: 0.031315 Nov 23 07:49:55.955082 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 491/928] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:49:55 2021] DELETE /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:49:55.967162 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f6a7647f-da5d-4e6e-8a22-4ef9aba1a269 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:49:55.968321 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f6a7647f-da5d-4e6e-8a22-4ef9aba1a269 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] [instance: 28c2d383-cc82-4479-b0fe-d92e63ef538d] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:49:55.979084 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f6a7647f-da5d-4e6e-8a22-4ef9aba1a269 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:55.979893 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f6a7647f-da5d-4e6e-8a22-4ef9aba1a269 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:55.981264 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f6a7647f-da5d-4e6e-8a22-4ef9aba1a269 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:49:55.982154 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f6a7647f-da5d-4e6e-8a22-4ef9aba1a269 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:49:56.004914 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-f6a7647f-da5d-4e6e-8a22-4ef9aba1a269 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] HTTP exception thrown: Instance 28c2d383-cc82-4479-b0fe-d92e63ef538d could not be found. Nov 23 07:49:56.006018 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f6a7647f-da5d-4e6e-8a22-4ef9aba1a269 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] Returning 404 to user: Instance 28c2d383-cc82-4479-b0fe-d92e63ef538d could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:49:56.007595 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f6a7647f-da5d-4e6e-8a22-4ef9aba1a269 tempest-AttachVolumeTestJSON-1017959362 tempest-AttachVolumeTestJSON-1017959362-project] 10.222.0.48 "GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d" status: 404 len: 111 microversion: 2.1 time: 0.047188 Nov 23 07:49:56.008647 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 438/929] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:49:55 2021] GET /compute/v2.1/servers/28c2d383-cc82-4479-b0fe-d92e63ef538d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:50:03.067040 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-603023cf-7627-4ed6-b43e-dec3504ab879 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-312976773", "imageRef": "6895b3b6-16b9-4e43-bf1b-c19e73615ca8", "flavorRef": "452", "networks": [{"uuid": "297aaeda-aecc-462b-bd77-2688259c1543"}]}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:50:03.152247 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.network.neutron [None req-603023cf-7627-4ed6-b43e-dec3504ab879 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] validate_networks() for [('297aaeda-aecc-462b-bd77-2688259c1543', None, None, None, None, None)] {{(pid=122786) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:50:03.578012 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-603023cf-7627-4ed6-b43e-dec3504ab879 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Flavor limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:50:03.578510 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-603023cf-7627-4ed6-b43e-dec3504ab879 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Image limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:50:03.578999 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-603023cf-7627-4ed6-b43e-dec3504ab879 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Flavor pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:50:03.579407 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-603023cf-7627-4ed6-b43e-dec3504ab879 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Image pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:50:03.579850 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-603023cf-7627-4ed6-b43e-dec3504ab879 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:50:03.592154 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-603023cf-7627-4ed6-b43e-dec3504ab879 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:03.592920 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-603023cf-7627-4ed6-b43e-dec3504ab879 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:03.594946 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-603023cf-7627-4ed6-b43e-dec3504ab879 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:03.595671 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-603023cf-7627-4ed6-b43e-dec3504ab879 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:03.623576 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-603023cf-7627-4ed6-b43e-dec3504ab879 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Getting quotas for project 93c77eb8adee494f8cddcb74d01e7183. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:50:03.629242 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-603023cf-7627-4ed6-b43e-dec3504ab879 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Getting quotas for user 4a32fdae11324218aed54988a2b9ec46 and project 93c77eb8adee494f8cddcb74d01e7183. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:50:03.651850 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-603023cf-7627-4ed6-b43e-dec3504ab879 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Going to run 1 instances... {{(pid=122786) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:50:03.659477 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-603023cf-7627-4ed6-b43e-dec3504ab879 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6895b3b6-16b9-4e43-bf1b-c19e73615ca8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:50:03.723197 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-603023cf-7627-4ed6-b43e-dec3504ab879 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.816708 Nov 23 07:50:03.732272 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 492/930] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Nov 23 07:50:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 07:50:03.742507 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-88638b3f-4b3b-4caa-9669-19646ad60689 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:03.743992 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-88638b3f-4b3b-4caa-9669-19646ad60689 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:03.824307 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-88638b3f-4b3b-4caa-9669-19646ad60689 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:03.846144 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-88638b3f-4b3b-4caa-9669-19646ad60689 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e" status: 200 len: 1217 microversion: 2.1 time: 0.101319 Nov 23 07:50:03.846144 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 439/931] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:03 2021] GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:04.856644 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-f66f49ea-c93a-4f9e-87df-5f60d2356ad5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:04.857240 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f66f49ea-c93a-4f9e-87df-5f60d2356ad5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:04.864103 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f66f49ea-c93a-4f9e-87df-5f60d2356ad5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:04.864545 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f66f49ea-c93a-4f9e-87df-5f60d2356ad5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:04.865534 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f66f49ea-c93a-4f9e-87df-5f60d2356ad5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:04.866013 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f66f49ea-c93a-4f9e-87df-5f60d2356ad5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:04.941324 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-f66f49ea-c93a-4f9e-87df-5f60d2356ad5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:04.948493 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-f66f49ea-c93a-4f9e-87df-5f60d2356ad5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e" status: 200 len: 1287 microversion: 2.1 time: 0.095814 Nov 23 07:50:04.949355 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 493/932] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:04 2021] GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e => generated 1287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:50:05.967332 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-449e3b8f-5835-40ef-9204-a4987b934843 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:05.967987 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-449e3b8f-5835-40ef-9204-a4987b934843 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:05.975706 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-449e3b8f-5835-40ef-9204-a4987b934843 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:05.976150 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-449e3b8f-5835-40ef-9204-a4987b934843 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:05.976933 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-449e3b8f-5835-40ef-9204-a4987b934843 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:05.977362 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-449e3b8f-5835-40ef-9204-a4987b934843 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:06.182624 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-449e3b8f-5835-40ef-9204-a4987b934843 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:06.192910 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-449e3b8f-5835-40ef-9204-a4987b934843 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e" status: 200 len: 1317 microversion: 2.1 time: 0.229142 Nov 23 07:50:06.202005 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 440/933] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:05 2021] GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:06.234508 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-74b87a13-2756-4a27-a928-30a2443af54e req-2b8f1fd8-822b-4919-8888-52b439cc5588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd14c70e-fcc6-45f7-950f-fe16de2e3c4e", "tag": "e6b62974-a146-42bc-98de-1fcf45a35bc8"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:50:06.236187 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:50:06.236187 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:50:06.244254 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-74b87a13-2756-4a27-a928-30a2443af54e req-2b8f1fd8-822b-4919-8888-52b439cc5588 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:06.244671 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-74b87a13-2756-4a27-a928-30a2443af54e req-2b8f1fd8-822b-4919-8888-52b439cc5588 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:06.265588 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-74b87a13-2756-4a27-a928-30a2443af54e req-2b8f1fd8-822b-4919-8888-52b439cc5588 service nova] Creating event network-changed:e6b62974-a146-42bc-98de-1fcf45a35bc8 for instance dd14c70e-fcc6-45f7-950f-fe16de2e3c4e on hv-cinder-80403 Nov 23 07:50:06.271128 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-74b87a13-2756-4a27-a928-30a2443af54e req-2b8f1fd8-822b-4919-8888-52b439cc5588 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041341 Nov 23 07:50:06.271927 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 494/934] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:50:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:50:07.214078 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d9b9c1a8-d10f-4963-9f0c-ba0c16938901 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:07.214704 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d9b9c1a8-d10f-4963-9f0c-ba0c16938901 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:07.221256 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d9b9c1a8-d10f-4963-9f0c-ba0c16938901 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:07.221732 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d9b9c1a8-d10f-4963-9f0c-ba0c16938901 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:07.222799 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d9b9c1a8-d10f-4963-9f0c-ba0c16938901 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:07.223312 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d9b9c1a8-d10f-4963-9f0c-ba0c16938901 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:07.473097 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d9b9c1a8-d10f-4963-9f0c-ba0c16938901 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:07.481912 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d9b9c1a8-d10f-4963-9f0c-ba0c16938901 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e" status: 200 len: 1317 microversion: 2.1 time: 0.271389 Nov 23 07:50:07.482500 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 441/935] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:07 2021] GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:08.499785 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b5a55b10-366a-4a4f-9a9d-7cae25994511 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:08.500540 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-b5a55b10-366a-4a4f-9a9d-7cae25994511 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:08.507841 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b5a55b10-366a-4a4f-9a9d-7cae25994511 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:08.508328 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b5a55b10-366a-4a4f-9a9d-7cae25994511 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:08.509257 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b5a55b10-366a-4a4f-9a9d-7cae25994511 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:08.509692 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b5a55b10-366a-4a4f-9a9d-7cae25994511 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:08.664400 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b5a55b10-366a-4a4f-9a9d-7cae25994511 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:08.678158 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b5a55b10-366a-4a4f-9a9d-7cae25994511 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e" status: 200 len: 1317 microversion: 2.1 time: 0.182006 Nov 23 07:50:08.679213 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 495/936] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:08 2021] GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:50:09.706485 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3f91a5ee-491b-4423-b9fc-575a87cf284c tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:09.707442 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3f91a5ee-491b-4423-b9fc-575a87cf284c tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:09.717113 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3f91a5ee-491b-4423-b9fc-575a87cf284c tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:09.717867 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3f91a5ee-491b-4423-b9fc-575a87cf284c tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:09.719383 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3f91a5ee-491b-4423-b9fc-575a87cf284c tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:09.719926 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3f91a5ee-491b-4423-b9fc-575a87cf284c tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:09.938918 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-3f91a5ee-491b-4423-b9fc-575a87cf284c tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:09.948308 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3f91a5ee-491b-4423-b9fc-575a87cf284c tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e" status: 200 len: 1317 microversion: 2.1 time: 0.246696 Nov 23 07:50:09.948915 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 442/937] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:09 2021] GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:10.755050 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d368e6bc-13fa-406c-9c56-5bf889809a94 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:10.756712 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d368e6bc-13fa-406c-9c56-5bf889809a94 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:10.769575 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d368e6bc-13fa-406c-9c56-5bf889809a94 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:10.770411 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d368e6bc-13fa-406c-9c56-5bf889809a94 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:10.771875 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d368e6bc-13fa-406c-9c56-5bf889809a94 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:10.772654 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d368e6bc-13fa-406c-9c56-5bf889809a94 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:10.808786 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d368e6bc-13fa-406c-9c56-5bf889809a94 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060529 Nov 23 07:50:10.809544 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 496/938] 10.222.0.48 () {60 vars in 1342 bytes} [Tue Nov 23 07:50:10 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:50:10.891679 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-32072f57-676d-43c0-acf2-7e304b999943 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:10.892322 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-32072f57-676d-43c0-acf2-7e304b999943 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:10.900544 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-32072f57-676d-43c0-acf2-7e304b999943 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:10.901149 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-32072f57-676d-43c0-acf2-7e304b999943 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:10.902148 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-32072f57-676d-43c0-acf2-7e304b999943 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:10.902687 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-32072f57-676d-43c0-acf2-7e304b999943 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:10.933896 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-32072f57-676d-43c0-acf2-7e304b999943 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Going to try to terminate instance {{(pid=122785) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:50:10.975866 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-dbbe7555-5716-478e-85d4-88eae35443c6 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:10.977065 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-dbbe7555-5716-478e-85d4-88eae35443c6 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:10.986696 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-dbbe7555-5716-478e-85d4-88eae35443c6 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:10.987567 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-dbbe7555-5716-478e-85d4-88eae35443c6 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:10.989223 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-dbbe7555-5716-478e-85d4-88eae35443c6 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:10.990198 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-dbbe7555-5716-478e-85d4-88eae35443c6 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:11.039590 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-32072f57-676d-43c0-acf2-7e304b999943 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "DELETE /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 204 len: 0 microversion: 2.20 time: 0.152574 Nov 23 07:50:11.041098 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 443/939] 10.222.0.48 () {60 vars in 1279 bytes} [Tue Nov 23 07:50:10 2021] DELETE /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 07:50:11.050137 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f5f1a9aa-7487-454c-a76b-9aa3e182d91b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:11.051031 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f5f1a9aa-7487-454c-a76b-9aa3e182d91b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:11.063901 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f5f1a9aa-7487-454c-a76b-9aa3e182d91b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:11.064548 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f5f1a9aa-7487-454c-a76b-9aa3e182d91b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:11.065635 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f5f1a9aa-7487-454c-a76b-9aa3e182d91b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:11.066411 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f5f1a9aa-7487-454c-a76b-9aa3e182d91b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:11.229474 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-dbbe7555-5716-478e-85d4-88eae35443c6 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:11.243023 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-dbbe7555-5716-478e-85d4-88eae35443c6 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e" status: 200 len: 1317 microversion: 2.1 time: 0.273239 Nov 23 07:50:11.244105 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 497/940] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:10 2021] GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:50:11.266301 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f5f1a9aa-7487-454c-a76b-9aa3e182d91b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:11.277046 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f5f1a9aa-7487-454c-a76b-9aa3e182d91b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:11.278876 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f5f1a9aa-7487-454c-a76b-9aa3e182d91b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:11.281061 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f5f1a9aa-7487-454c-a76b-9aa3e182d91b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1722 microversion: 2.20 time: 0.234759 Nov 23 07:50:11.282240 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 444/941] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:50:11 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:50:11.461890 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-e2d0ac82-6b0c-419c-9541-222c186ddc21 req-36db05c0-1931-4394-8dd6-ff2d0d513caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd14c70e-fcc6-45f7-950f-fe16de2e3c4e", "name": "network-vif-plugged", "status": "completed", "tag": "e6b62974-a146-42bc-98de-1fcf45a35bc8"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:50:11.463547 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:50:11.463547 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:50:11.472077 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-e2d0ac82-6b0c-419c-9541-222c186ddc21 req-36db05c0-1931-4394-8dd6-ff2d0d513caf service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:11.472674 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-e2d0ac82-6b0c-419c-9541-222c186ddc21 req-36db05c0-1931-4394-8dd6-ff2d0d513caf service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:11.490451 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-e2d0ac82-6b0c-419c-9541-222c186ddc21 req-36db05c0-1931-4394-8dd6-ff2d0d513caf service nova] Creating event network-vif-plugged:e6b62974-a146-42bc-98de-1fcf45a35bc8 for instance dd14c70e-fcc6-45f7-950f-fe16de2e3c4e on hv-cinder-80403 Nov 23 07:50:11.498146 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-e2d0ac82-6b0c-419c-9541-222c186ddc21 req-36db05c0-1931-4394-8dd6-ff2d0d513caf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039598 Nov 23 07:50:11.499199 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 498/942] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:50:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:50:12.270208 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-af28c482-f847-4c4e-8824-8b21d46be474 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:12.271007 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-af28c482-f847-4c4e-8824-8b21d46be474 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:12.280051 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-af28c482-f847-4c4e-8824-8b21d46be474 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:12.280790 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-af28c482-f847-4c4e-8824-8b21d46be474 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:12.282070 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-af28c482-f847-4c4e-8824-8b21d46be474 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:12.282641 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-af28c482-f847-4c4e-8824-8b21d46be474 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:12.306559 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-7a77104f-644c-4979-9eb0-2cfd0f737d69 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:12.307609 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-7a77104f-644c-4979-9eb0-2cfd0f737d69 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:12.318627 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7a77104f-644c-4979-9eb0-2cfd0f737d69 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:12.319419 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7a77104f-644c-4979-9eb0-2cfd0f737d69 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:12.320715 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7a77104f-644c-4979-9eb0-2cfd0f737d69 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:12.321365 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7a77104f-644c-4979-9eb0-2cfd0f737d69 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:12.475710 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-af28c482-f847-4c4e-8824-8b21d46be474 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:12.492294 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-af28c482-f847-4c4e-8824-8b21d46be474 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e" status: 200 len: 1317 microversion: 2.1 time: 0.226602 Nov 23 07:50:12.493490 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 445/943] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:12 2021] GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:12.525016 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-7a77104f-644c-4979-9eb0-2cfd0f737d69 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:12.537854 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-7a77104f-644c-4979-9eb0-2cfd0f737d69 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:12.539972 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-7a77104f-644c-4979-9eb0-2cfd0f737d69 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:12.541466 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-7a77104f-644c-4979-9eb0-2cfd0f737d69 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1722 microversion: 2.20 time: 0.242951 Nov 23 07:50:12.542307 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 499/944] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:50:12 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 07:50:13.515217 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3146f8d8-c3ff-4abb-b185-712c608410ef tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:13.517961 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3146f8d8-c3ff-4abb-b185-712c608410ef tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:13.529087 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3146f8d8-c3ff-4abb-b185-712c608410ef tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:13.529946 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3146f8d8-c3ff-4abb-b185-712c608410ef tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:13.531940 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3146f8d8-c3ff-4abb-b185-712c608410ef tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:13.532734 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3146f8d8-c3ff-4abb-b185-712c608410ef tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:13.574425 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a3c8d1a0-4871-4de0-b3eb-2c81a169af6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:13.575177 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a3c8d1a0-4871-4de0-b3eb-2c81a169af6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:13.587110 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a3c8d1a0-4871-4de0-b3eb-2c81a169af6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:13.587890 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a3c8d1a0-4871-4de0-b3eb-2c81a169af6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:13.589298 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a3c8d1a0-4871-4de0-b3eb-2c81a169af6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:13.590411 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a3c8d1a0-4871-4de0-b3eb-2c81a169af6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:13.707815 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a3c8d1a0-4871-4de0-b3eb-2c81a169af6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:13.720998 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a3c8d1a0-4871-4de0-b3eb-2c81a169af6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:13.722884 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a3c8d1a0-4871-4de0-b3eb-2c81a169af6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '204926c3a4fe4664bc1cd685b57fe015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd4c40a2d5e481eadb2fc728cc0ca5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:13.724363 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a3c8d1a0-4871-4de0-b3eb-2c81a169af6b tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 200 len: 1654 microversion: 2.20 time: 0.157316 Nov 23 07:50:13.725094 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 500/945] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:50:13 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 1654 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 07:50:13.865855 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-3146f8d8-c3ff-4abb-b185-712c608410ef tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:13.874016 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3146f8d8-c3ff-4abb-b185-712c608410ef tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e" status: 200 len: 1507 microversion: 2.1 time: 0.366401 Nov 23 07:50:13.874726 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 446/946] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:13 2021] GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e => generated 1507 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:50:14.088766 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-a4c99a43-49aa-4e79-a586-b378050697c7 req-a0735771-e941-41bd-b809-5048f1661e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d02284-ac69-4605-bd8e-1c29644f219c", "name": "network-vif-deleted", "tag": "7bb628ce-17b8-43a9-8265-270514936b86"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:50:14.090480 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:50:14.090480 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:50:14.103785 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-a4c99a43-49aa-4e79-a586-b378050697c7 req-a0735771-e941-41bd-b809-5048f1661e95 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:14.104965 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-a4c99a43-49aa-4e79-a586-b378050697c7 req-a0735771-e941-41bd-b809-5048f1661e95 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:14.142949 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-a4c99a43-49aa-4e79-a586-b378050697c7 req-a0735771-e941-41bd-b809-5048f1661e95 service nova] Creating event network-vif-deleted:7bb628ce-17b8-43a9-8265-270514936b86 for instance 36d02284-ac69-4605-bd8e-1c29644f219c on hv-cinder-80403 Nov 23 07:50:14.148899 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-a4c99a43-49aa-4e79-a586-b378050697c7 req-a0735771-e941-41bd-b809-5048f1661e95 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063686 Nov 23 07:50:14.150070 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 501/947] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:50:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:50:14.755149 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-daa2f075-d0d0-435d-8536-9c94491322eb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:14.756216 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-daa2f075-d0d0-435d-8536-9c94491322eb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:14.771663 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-daa2f075-d0d0-435d-8536-9c94491322eb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:14.771663 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-daa2f075-d0d0-435d-8536-9c94491322eb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:14.771663 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-daa2f075-d0d0-435d-8536-9c94491322eb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:14.771663 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-daa2f075-d0d0-435d-8536-9c94491322eb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:14.789659 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-daa2f075-d0d0-435d-8536-9c94491322eb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] HTTP exception thrown: Instance 36d02284-ac69-4605-bd8e-1c29644f219c could not be found. Nov 23 07:50:14.790505 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-daa2f075-d0d0-435d-8536-9c94491322eb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Returning 404 to user: Instance 36d02284-ac69-4605-bd8e-1c29644f219c could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:50:14.791557 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-daa2f075-d0d0-435d-8536-9c94491322eb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 404 len: 111 microversion: 2.20 time: 0.042479 Nov 23 07:50:14.792108 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 447/948] 10.222.0.48 () {60 vars in 1276 bytes} [Tue Nov 23 07:50:14 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 23 07:50:14.808566 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d59781ec-0b12-43e2-90a3-a40ecefae485 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '.version_select at 0x7f05145da040>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:14.837134 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d59781ec-0b12-43e2-90a3-a40ecefae485 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-968653804" status: 204 len: 0 microversion: 2.20 time: 0.036773 Nov 23 07:50:14.838387 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 502/949] 10.222.0.48 () {60 vars in 1258 bytes} [Tue Nov 23 07:50:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-968653804 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 07:50:15.413906 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-b4736445-ae72-4ced-8100-494882b8c684 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e9b7f58-badd-472e-a4c1-73ff1095ccf9"}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:50:15.415216 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-b4736445-ae72-4ced-8100-494882b8c684 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:15.422493 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b4736445-ae72-4ced-8100-494882b8c684 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:15.422938 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b4736445-ae72-4ced-8100-494882b8c684 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:15.423957 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b4736445-ae72-4ced-8100-494882b8c684 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:15.424610 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b4736445-ae72-4ced-8100-494882b8c684 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:15.758871 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-b4736445-ae72-4ced-8100-494882b8c684 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "POST /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348485 Nov 23 07:50:15.761190 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 448/950] 10.222.0.48 () {60 vars in 1322 bytes} [Tue Nov 23 07:50:15 2021] POST /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:50:16.895267 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-73b98324-eebf-4cf5-90a0-899620830174 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:16.896238 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-73b98324-eebf-4cf5-90a0-899620830174 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:16.907863 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-73b98324-eebf-4cf5-90a0-899620830174 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:16.908690 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-73b98324-eebf-4cf5-90a0-899620830174 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:16.910356 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-73b98324-eebf-4cf5-90a0-899620830174 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:16.912464 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-73b98324-eebf-4cf5-90a0-899620830174 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:16.936527 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-73b98324-eebf-4cf5-90a0-899620830174 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] HTTP exception thrown: Instance 36d02284-ac69-4605-bd8e-1c29644f219c could not be found. Nov 23 07:50:16.937126 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-73b98324-eebf-4cf5-90a0-899620830174 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Returning 404 to user: Instance 36d02284-ac69-4605-bd8e-1c29644f219c could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:50:16.938542 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-73b98324-eebf-4cf5-90a0-899620830174 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "DELETE /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 404 len: 111 microversion: 2.1 time: 0.051311 Nov 23 07:50:16.939102 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 503/951] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:50:16 2021] DELETE /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:50:16.948249 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-533b7f50-618e-4ebc-97dc-90ffdc0e2371 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:16.948954 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-533b7f50-618e-4ebc-97dc-90ffdc0e2371 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: 36d02284-ac69-4605-bd8e-1c29644f219c] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:16.955743 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-533b7f50-618e-4ebc-97dc-90ffdc0e2371 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:16.956190 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-533b7f50-618e-4ebc-97dc-90ffdc0e2371 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:16.956990 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-533b7f50-618e-4ebc-97dc-90ffdc0e2371 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:16.957425 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-533b7f50-618e-4ebc-97dc-90ffdc0e2371 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:16.973219 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-533b7f50-618e-4ebc-97dc-90ffdc0e2371 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] HTTP exception thrown: Instance 36d02284-ac69-4605-bd8e-1c29644f219c could not be found. Nov 23 07:50:16.973855 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-533b7f50-618e-4ebc-97dc-90ffdc0e2371 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Returning 404 to user: Instance 36d02284-ac69-4605-bd8e-1c29644f219c could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:50:16.974701 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-533b7f50-618e-4ebc-97dc-90ffdc0e2371 tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c" status: 404 len: 111 microversion: 2.1 time: 0.031009 Nov 23 07:50:16.975278 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 449/952] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:16 2021] GET /compute/v2.1/servers/36d02284-ac69-4605-bd8e-1c29644f219c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:50:18.166193 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-638e13ab-569c-48fe-b32e-efd73094404c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:18.167086 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-638e13ab-569c-48fe-b32e-efd73094404c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:18.177540 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-638e13ab-569c-48fe-b32e-efd73094404c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:18.178164 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-638e13ab-569c-48fe-b32e-efd73094404c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:18.179508 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-638e13ab-569c-48fe-b32e-efd73094404c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:18.180327 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-638e13ab-569c-48fe-b32e-efd73094404c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:18.202812 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-638e13ab-569c-48fe-b32e-efd73094404c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] HTTP exception thrown: Instance bb841a35-6344-43a0-85d2-6de8116759b1 could not be found. Nov 23 07:50:18.203832 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-638e13ab-569c-48fe-b32e-efd73094404c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Returning 404 to user: Instance bb841a35-6344-43a0-85d2-6de8116759b1 could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:50:18.204682 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-638e13ab-569c-48fe-b32e-efd73094404c tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 404 len: 111 microversion: 2.1 time: 0.045535 Nov 23 07:50:18.205260 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 504/953] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:50:18 2021] DELETE /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 07:50:18.213379 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-185b2fe3-d238-4ebc-94c3-e5ca67abe4cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:18.214103 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-185b2fe3-d238-4ebc-94c3-e5ca67abe4cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] [instance: bb841a35-6344-43a0-85d2-6de8116759b1] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:18.221125 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-185b2fe3-d238-4ebc-94c3-e5ca67abe4cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:18.221566 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-185b2fe3-d238-4ebc-94c3-e5ca67abe4cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:18.222383 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-185b2fe3-d238-4ebc-94c3-e5ca67abe4cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:18.222815 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-185b2fe3-d238-4ebc-94c3-e5ca67abe4cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:18.238070 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-185b2fe3-d238-4ebc-94c3-e5ca67abe4cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] HTTP exception thrown: Instance bb841a35-6344-43a0-85d2-6de8116759b1 could not be found. Nov 23 07:50:18.238664 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-185b2fe3-d238-4ebc-94c3-e5ca67abe4cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] Returning 404 to user: Instance bb841a35-6344-43a0-85d2-6de8116759b1 could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:50:18.239499 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-185b2fe3-d238-4ebc-94c3-e5ca67abe4cb tempest-AttachVolumeShelveTestJSON-1497887931 tempest-AttachVolumeShelveTestJSON-1497887931-project] 10.222.0.48 "GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1" status: 404 len: 111 microversion: 2.1 time: 0.029879 Nov 23 07:50:18.240049 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 450/954] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:18 2021] GET /compute/v2.1/servers/bb841a35-6344-43a0-85d2-6de8116759b1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:50:23.514602 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-26d6a9e6-b476-420e-8bd1-4782e536bb7a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-406293688", "imageRef": "6895b3b6-16b9-4e43-bf1b-c19e73615ca8", "flavorRef": "452", "networks": [{"uuid": "297aaeda-aecc-462b-bd77-2688259c1543"}]}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:50:23.578707 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.network.neutron [None req-26d6a9e6-b476-420e-8bd1-4782e536bb7a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] validate_networks() for [('297aaeda-aecc-462b-bd77-2688259c1543', None, None, None, None, None)] {{(pid=122786) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:50:23.970719 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-26d6a9e6-b476-420e-8bd1-4782e536bb7a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Flavor limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:50:23.971239 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-26d6a9e6-b476-420e-8bd1-4782e536bb7a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Image limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:50:23.971785 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-26d6a9e6-b476-420e-8bd1-4782e536bb7a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Flavor pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:50:23.972265 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-26d6a9e6-b476-420e-8bd1-4782e536bb7a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Image pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:50:23.972751 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-26d6a9e6-b476-420e-8bd1-4782e536bb7a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:50:23.982494 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-26d6a9e6-b476-420e-8bd1-4782e536bb7a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:23.983116 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-26d6a9e6-b476-420e-8bd1-4782e536bb7a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:23.983947 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-26d6a9e6-b476-420e-8bd1-4782e536bb7a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:23.985044 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-26d6a9e6-b476-420e-8bd1-4782e536bb7a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:24.003007 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-26d6a9e6-b476-420e-8bd1-4782e536bb7a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Getting quotas for project 93c77eb8adee494f8cddcb74d01e7183. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:50:24.007807 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-26d6a9e6-b476-420e-8bd1-4782e536bb7a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Getting quotas for user 4a32fdae11324218aed54988a2b9ec46 and project 93c77eb8adee494f8cddcb74d01e7183. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:50:24.020422 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-26d6a9e6-b476-420e-8bd1-4782e536bb7a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Going to run 1 instances... {{(pid=122786) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:50:24.023006 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-26d6a9e6-b476-420e-8bd1-4782e536bb7a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3fce3d66-d323-4507-8ba9-d8cc96d4e92f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6895b3b6-16b9-4e43-bf1b-c19e73615ca8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:50:24.071237 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-26d6a9e6-b476-420e-8bd1-4782e536bb7a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560555 Nov 23 07:50:24.073951 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 505/955] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Nov 23 07:50:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 07:50:24.082786 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-b6131c9b-ae11-47d9-be12-43a905b1fbd3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:24.083430 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-b6131c9b-ae11-47d9-be12-43a905b1fbd3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3fce3d66-d323-4507-8ba9-d8cc96d4e92f] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:24.143758 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-b6131c9b-ae11-47d9-be12-43a905b1fbd3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:24.151086 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-b6131c9b-ae11-47d9-be12-43a905b1fbd3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f" status: 200 len: 1217 microversion: 2.1 time: 0.071343 Nov 23 07:50:24.152162 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 451/956] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:24 2021] GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:50:25.169961 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-9c82a999-921c-42b8-9d97-95370856af05 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:25.170701 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-9c82a999-921c-42b8-9d97-95370856af05 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3fce3d66-d323-4507-8ba9-d8cc96d4e92f] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:25.176873 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9c82a999-921c-42b8-9d97-95370856af05 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:25.177625 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9c82a999-921c-42b8-9d97-95370856af05 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:25.178459 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9c82a999-921c-42b8-9d97-95370856af05 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:25.178886 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9c82a999-921c-42b8-9d97-95370856af05 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:25.259767 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-9c82a999-921c-42b8-9d97-95370856af05 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:25.268416 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-9c82a999-921c-42b8-9d97-95370856af05 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f" status: 200 len: 1277 microversion: 2.1 time: 0.102779 Nov 23 07:50:25.269335 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 506/957] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:25 2021] GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:26.287446 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-19dd0706-f879-4f7f-8b59-07fa803665b1 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:26.288252 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-19dd0706-f879-4f7f-8b59-07fa803665b1 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3fce3d66-d323-4507-8ba9-d8cc96d4e92f] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:26.295764 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-19dd0706-f879-4f7f-8b59-07fa803665b1 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:26.296212 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-19dd0706-f879-4f7f-8b59-07fa803665b1 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:26.297538 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-19dd0706-f879-4f7f-8b59-07fa803665b1 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:26.298047 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-19dd0706-f879-4f7f-8b59-07fa803665b1 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:26.641747 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-19dd0706-f879-4f7f-8b59-07fa803665b1 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:26.650941 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-19dd0706-f879-4f7f-8b59-07fa803665b1 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f" status: 200 len: 1317 microversion: 2.1 time: 0.368099 Nov 23 07:50:26.652163 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 452/958] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:26 2021] GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:26.826563 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-8367e089-0617-4dd1-8fae-e242f16ef4dc req-e567ed11-92df-4072-8af3-e7e4f5566a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fce3d66-d323-4507-8ba9-d8cc96d4e92f", "tag": "b0419753-47d6-423f-8dd1-7b53b313da63"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:50:26.829173 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:50:26.829173 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:50:26.840008 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-8367e089-0617-4dd1-8fae-e242f16ef4dc req-e567ed11-92df-4072-8af3-e7e4f5566a3e service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:26.841351 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-8367e089-0617-4dd1-8fae-e242f16ef4dc req-e567ed11-92df-4072-8af3-e7e4f5566a3e service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:26.854767 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-8367e089-0617-4dd1-8fae-e242f16ef4dc req-e567ed11-92df-4072-8af3-e7e4f5566a3e service nova] Creating event network-changed:b0419753-47d6-423f-8dd1-7b53b313da63 for instance 3fce3d66-d323-4507-8ba9-d8cc96d4e92f on hv-cinder-80403 Nov 23 07:50:26.861943 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-8367e089-0617-4dd1-8fae-e242f16ef4dc req-e567ed11-92df-4072-8af3-e7e4f5566a3e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039098 Nov 23 07:50:26.862842 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 507/959] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:50:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:50:27.669164 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-028f64f3-3bd7-4aa3-80ad-b966192cac5f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:27.674901 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-028f64f3-3bd7-4aa3-80ad-b966192cac5f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3fce3d66-d323-4507-8ba9-d8cc96d4e92f] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:27.681776 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-028f64f3-3bd7-4aa3-80ad-b966192cac5f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:27.682265 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-028f64f3-3bd7-4aa3-80ad-b966192cac5f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:27.683067 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-028f64f3-3bd7-4aa3-80ad-b966192cac5f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:27.683502 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-028f64f3-3bd7-4aa3-80ad-b966192cac5f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:27.942927 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-028f64f3-3bd7-4aa3-80ad-b966192cac5f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:27.956448 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-028f64f3-3bd7-4aa3-80ad-b966192cac5f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f" status: 200 len: 1317 microversion: 2.1 time: 0.290609 Nov 23 07:50:27.957507 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 453/960] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:27 2021] GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:28.981803 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-378ea662-fdc3-44b0-8d9e-335943a2235a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:28.982519 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-378ea662-fdc3-44b0-8d9e-335943a2235a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3fce3d66-d323-4507-8ba9-d8cc96d4e92f] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:28.988980 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-378ea662-fdc3-44b0-8d9e-335943a2235a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:28.989450 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-378ea662-fdc3-44b0-8d9e-335943a2235a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:28.990357 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-378ea662-fdc3-44b0-8d9e-335943a2235a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:28.990797 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-378ea662-fdc3-44b0-8d9e-335943a2235a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:29.142900 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-378ea662-fdc3-44b0-8d9e-335943a2235a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:29.150629 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-378ea662-fdc3-44b0-8d9e-335943a2235a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f" status: 200 len: 1317 microversion: 2.1 time: 0.173272 Nov 23 07:50:29.151206 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 508/961] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:28 2021] GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:50:30.167921 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-04d163c6-f29c-4c6d-bcd6-f0666f9c1ae1 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:30.168701 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-04d163c6-f29c-4c6d-bcd6-f0666f9c1ae1 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3fce3d66-d323-4507-8ba9-d8cc96d4e92f] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:30.175615 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-04d163c6-f29c-4c6d-bcd6-f0666f9c1ae1 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:30.176065 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-04d163c6-f29c-4c6d-bcd6-f0666f9c1ae1 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:30.176868 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-04d163c6-f29c-4c6d-bcd6-f0666f9c1ae1 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:30.177295 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-04d163c6-f29c-4c6d-bcd6-f0666f9c1ae1 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:30.323721 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-04d163c6-f29c-4c6d-bcd6-f0666f9c1ae1 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:30.333040 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-04d163c6-f29c-4c6d-bcd6-f0666f9c1ae1 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f" status: 200 len: 1317 microversion: 2.1 time: 0.168464 Nov 23 07:50:30.333867 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 454/962] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:30 2021] GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:31.352940 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-b6ad63b4-0798-4a92-9ae0-82d8171f7da9 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:31.352940 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-b6ad63b4-0798-4a92-9ae0-82d8171f7da9 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3fce3d66-d323-4507-8ba9-d8cc96d4e92f] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:31.358648 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b6ad63b4-0798-4a92-9ae0-82d8171f7da9 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:31.359643 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b6ad63b4-0798-4a92-9ae0-82d8171f7da9 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:31.360442 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b6ad63b4-0798-4a92-9ae0-82d8171f7da9 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:31.360870 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-b6ad63b4-0798-4a92-9ae0-82d8171f7da9 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:31.555747 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-b6ad63b4-0798-4a92-9ae0-82d8171f7da9 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:31.564355 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-b6ad63b4-0798-4a92-9ae0-82d8171f7da9 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f" status: 200 len: 1317 microversion: 2.1 time: 0.215681 Nov 23 07:50:31.564355 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 509/963] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:31 2021] GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:31.591325 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-2ee87d1b-1919-4402-84d6-36fe612abf18 req-12baf998-0c13-4629-a003-50f06e249906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fce3d66-d323-4507-8ba9-d8cc96d4e92f", "name": "network-vif-plugged", "status": "completed", "tag": "b0419753-47d6-423f-8dd1-7b53b313da63"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:50:31.592963 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:50:31.592963 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:50:31.601449 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-2ee87d1b-1919-4402-84d6-36fe612abf18 req-12baf998-0c13-4629-a003-50f06e249906 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:31.601449 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-2ee87d1b-1919-4402-84d6-36fe612abf18 req-12baf998-0c13-4629-a003-50f06e249906 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:31.613677 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-2ee87d1b-1919-4402-84d6-36fe612abf18 req-12baf998-0c13-4629-a003-50f06e249906 service nova] Creating event network-vif-plugged:b0419753-47d6-423f-8dd1-7b53b313da63 for instance 3fce3d66-d323-4507-8ba9-d8cc96d4e92f on hv-cinder-80403 Nov 23 07:50:31.618813 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-2ee87d1b-1919-4402-84d6-36fe612abf18 req-12baf998-0c13-4629-a003-50f06e249906 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031118 Nov 23 07:50:31.619417 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 455/964] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:50:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:50:32.581545 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ee82782b-646f-4350-956a-c412e2770b80 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:32.582376 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ee82782b-646f-4350-956a-c412e2770b80 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3fce3d66-d323-4507-8ba9-d8cc96d4e92f] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:32.589535 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ee82782b-646f-4350-956a-c412e2770b80 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:32.590133 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ee82782b-646f-4350-956a-c412e2770b80 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:32.590841 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ee82782b-646f-4350-956a-c412e2770b80 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:32.591281 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ee82782b-646f-4350-956a-c412e2770b80 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:32.767566 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ee82782b-646f-4350-956a-c412e2770b80 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:32.775883 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ee82782b-646f-4350-956a-c412e2770b80 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f" status: 200 len: 1317 microversion: 2.1 time: 0.198385 Nov 23 07:50:32.776449 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 510/965] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:32 2021] GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:33.798274 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-678f0ea4-fc19-40ef-b2ba-32ab3b843cdb tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:33.799353 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-678f0ea4-fc19-40ef-b2ba-32ab3b843cdb tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3fce3d66-d323-4507-8ba9-d8cc96d4e92f] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:33.806876 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-678f0ea4-fc19-40ef-b2ba-32ab3b843cdb tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:33.807315 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-678f0ea4-fc19-40ef-b2ba-32ab3b843cdb tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:33.808105 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-678f0ea4-fc19-40ef-b2ba-32ab3b843cdb tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:33.808533 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-678f0ea4-fc19-40ef-b2ba-32ab3b843cdb tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:33.965690 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-678f0ea4-fc19-40ef-b2ba-32ab3b843cdb tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:33.973575 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-678f0ea4-fc19-40ef-b2ba-32ab3b843cdb tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f" status: 200 len: 1507 microversion: 2.1 time: 0.181634 Nov 23 07:50:33.974657 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 456/966] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:33 2021] GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:33.992241 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4dab643c-4aae-4a98-87cf-806f5a502e13 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e9b7f58-badd-472e-a4c1-73ff1095ccf9"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:50:33.993289 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4dab643c-4aae-4a98-87cf-806f5a502e13 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3fce3d66-d323-4507-8ba9-d8cc96d4e92f] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:34.000545 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4dab643c-4aae-4a98-87cf-806f5a502e13 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:34.001002 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4dab643c-4aae-4a98-87cf-806f5a502e13 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:34.001866 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4dab643c-4aae-4a98-87cf-806f5a502e13 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:34.002312 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4dab643c-4aae-4a98-87cf-806f5a502e13 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:34.095934 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-4dab643c-4aae-4a98-87cf-806f5a502e13 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] HTTP exception thrown: Invalid volume: volume 0e9b7f58-badd-472e-a4c1-73ff1095ccf9 is already attached to instances: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e Nov 23 07:50:34.096689 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4dab643c-4aae-4a98-87cf-806f5a502e13 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Returning 400 to user: Invalid volume: volume 0e9b7f58-badd-472e-a4c1-73ff1095ccf9 is already attached to instances: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:50:34.097663 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4dab643c-4aae-4a98-87cf-806f5a502e13 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "POST /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109431 Nov 23 07:50:34.098290 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 511/967] 10.222.0.48 () {60 vars in 1322 bytes} [Tue Nov 23 07:50:33 2021] POST /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 23 07:50:34.162569 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-aa995fc0-1520-4bee-bc58-64e9d4876aa2 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:34.163191 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-aa995fc0-1520-4bee-bc58-64e9d4876aa2 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:34.170283 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aa995fc0-1520-4bee-bc58-64e9d4876aa2 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:34.170969 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aa995fc0-1520-4bee-bc58-64e9d4876aa2 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:34.172645 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aa995fc0-1520-4bee-bc58-64e9d4876aa2 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:34.173326 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-aa995fc0-1520-4bee-bc58-64e9d4876aa2 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:34.279821 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.objects.instance [None req-aa995fc0-1520-4bee-bc58-64e9d4876aa2 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lazy-loading 'services' on Instance uuid dd14c70e-fcc6-45f7-950f-fe16de2e3c4e {{(pid=122785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:50:34.354471 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-aa995fc0-1520-4bee-bc58-64e9d4876aa2 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e/os-volume_attachments/0e9b7f58-badd-472e-a4c1-73ff1095ccf9" status: 202 len: 0 microversion: 2.1 time: 0.200131 Nov 23 07:50:34.355259 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 457/968] 10.222.0.48 () {58 vars in 1415 bytes} [Tue Nov 23 07:50:34 2021] DELETE /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e/os-volume_attachments/0e9b7f58-badd-472e-a4c1-73ff1095ccf9 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:50:34.369254 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c7e817da-f59f-42ad-baaf-93119a3cec48 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:34.369254 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c7e817da-f59f-42ad-baaf-93119a3cec48 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:34.377014 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c7e817da-f59f-42ad-baaf-93119a3cec48 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:34.377589 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c7e817da-f59f-42ad-baaf-93119a3cec48 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:34.378473 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c7e817da-f59f-42ad-baaf-93119a3cec48 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:34.378918 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c7e817da-f59f-42ad-baaf-93119a3cec48 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:34.415746 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c7e817da-f59f-42ad-baaf-93119a3cec48 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055460 Nov 23 07:50:34.416351 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 512/969] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:50:34 2021] GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:50:35.431427 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-edda9d2c-0ca8-4497-aeec-6e1a2ae17622 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:35.434152 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-edda9d2c-0ca8-4497-aeec-6e1a2ae17622 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:35.442906 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-edda9d2c-0ca8-4497-aeec-6e1a2ae17622 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:35.443350 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-edda9d2c-0ca8-4497-aeec-6e1a2ae17622 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:35.444138 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-edda9d2c-0ca8-4497-aeec-6e1a2ae17622 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:35.444566 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-edda9d2c-0ca8-4497-aeec-6e1a2ae17622 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:35.506777 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-edda9d2c-0ca8-4497-aeec-6e1a2ae17622 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082407 Nov 23 07:50:35.511528 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 458/970] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:50:35 2021] GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:50:35.703863 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-9a5ee940-030a-4db3-8a33-76dc5b4b60f3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1242526012", "imageRef": "6895b3b6-16b9-4e43-bf1b-c19e73615ca8", "flavorRef": "452", "networks": [{"uuid": "297aaeda-aecc-462b-bd77-2688259c1543"}]}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:50:35.756003 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.network.neutron [None req-9a5ee940-030a-4db3-8a33-76dc5b4b60f3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] validate_networks() for [('297aaeda-aecc-462b-bd77-2688259c1543', None, None, None, None, None)] {{(pid=122786) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:50:36.153382 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-9a5ee940-030a-4db3-8a33-76dc5b4b60f3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Flavor limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:50:36.153964 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-9a5ee940-030a-4db3-8a33-76dc5b4b60f3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Image limits 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:50:36.154849 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-9a5ee940-030a-4db3-8a33-76dc5b4b60f3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Flavor pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:50:36.155609 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-9a5ee940-030a-4db3-8a33-76dc5b4b60f3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Image pref 0:0:0 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:50:36.156722 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.virt.hardware [None req-9a5ee940-030a-4db3-8a33-76dc5b4b60f3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:50:36.168292 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9a5ee940-030a-4db3-8a33-76dc5b4b60f3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:36.168745 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9a5ee940-030a-4db3-8a33-76dc5b4b60f3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:36.169864 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9a5ee940-030a-4db3-8a33-76dc5b4b60f3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:36.170307 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9a5ee940-030a-4db3-8a33-76dc5b4b60f3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:36.187588 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-9a5ee940-030a-4db3-8a33-76dc5b4b60f3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Getting quotas for project 93c77eb8adee494f8cddcb74d01e7183. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:50:36.191611 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.quota [None req-9a5ee940-030a-4db3-8a33-76dc5b4b60f3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Getting quotas for user 4a32fdae11324218aed54988a2b9ec46 and project 93c77eb8adee494f8cddcb74d01e7183. Resources: {'instances', 'cores', 'ram'} {{(pid=122786) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:50:36.203447 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-9a5ee940-030a-4db3-8a33-76dc5b4b60f3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Going to run 1 instances... {{(pid=122786) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:50:36.205782 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-9a5ee940-030a-4db3-8a33-76dc5b4b60f3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6895b3b6-16b9-4e43-bf1b-c19e73615ca8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:50:36.258938 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-9a5ee940-030a-4db3-8a33-76dc5b4b60f3 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558284 Nov 23 07:50:36.259637 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 513/971] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Nov 23 07:50:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 07:50:36.272156 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-b679c73d-1058-44ca-8f71-7cd701142cef tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:36.272994 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-b679c73d-1058-44ca-8f71-7cd701142cef tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:36.335278 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-b679c73d-1058-44ca-8f71-7cd701142cef tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:36.342022 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-b679c73d-1058-44ca-8f71-7cd701142cef tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b" status: 200 len: 1218 microversion: 2.1 time: 0.074449 Nov 23 07:50:36.342600 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 459/972] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:36 2021] GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:37.361761 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-f97b9eb5-6d26-4f81-848b-f42637407e16 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:37.362298 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f97b9eb5-6d26-4f81-848b-f42637407e16 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:37.378632 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f97b9eb5-6d26-4f81-848b-f42637407e16 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:37.379930 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f97b9eb5-6d26-4f81-848b-f42637407e16 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:37.383864 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f97b9eb5-6d26-4f81-848b-f42637407e16 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:37.385319 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f97b9eb5-6d26-4f81-848b-f42637407e16 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:37.501147 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-f97b9eb5-6d26-4f81-848b-f42637407e16 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:37.509625 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-f97b9eb5-6d26-4f81-848b-f42637407e16 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b" status: 200 len: 1278 microversion: 2.1 time: 0.152700 Nov 23 07:50:37.510645 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 514/973] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:37 2021] GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:38.532322 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-8bbac641-b6f8-444b-802b-ee6dbb4ab3f6 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:38.533235 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-8bbac641-b6f8-444b-802b-ee6dbb4ab3f6 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:38.544610 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8bbac641-b6f8-444b-802b-ee6dbb4ab3f6 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:38.545549 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8bbac641-b6f8-444b-802b-ee6dbb4ab3f6 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:38.547027 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8bbac641-b6f8-444b-802b-ee6dbb4ab3f6 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:38.548100 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8bbac641-b6f8-444b-802b-ee6dbb4ab3f6 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:38.789998 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-8bbac641-b6f8-444b-802b-ee6dbb4ab3f6 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:38.798084 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-8bbac641-b6f8-444b-802b-ee6dbb4ab3f6 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b" status: 200 len: 1318 microversion: 2.1 time: 0.273806 Nov 23 07:50:38.798775 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 460/974] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:38 2021] GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:38.992171 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-884eaa20-757b-4914-95e7-6862ae293b8e req-f61da431-35de-43c4-b6ee-c5262176fdce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebe5ca4-b941-4d96-9c13-8cbe51b0236b", "tag": "99777abd-c894-4087-bb08-0fe3fe38c8c7"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:50:38.994484 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:50:38.994484 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:50:39.002474 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-884eaa20-757b-4914-95e7-6862ae293b8e req-f61da431-35de-43c4-b6ee-c5262176fdce service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:39.002913 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-884eaa20-757b-4914-95e7-6862ae293b8e req-f61da431-35de-43c4-b6ee-c5262176fdce service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:39.018198 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-884eaa20-757b-4914-95e7-6862ae293b8e req-f61da431-35de-43c4-b6ee-c5262176fdce service nova] Creating event network-changed:99777abd-c894-4087-bb08-0fe3fe38c8c7 for instance 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b on hv-cinder-80403 Nov 23 07:50:39.025276 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-884eaa20-757b-4914-95e7-6862ae293b8e req-f61da431-35de-43c4-b6ee-c5262176fdce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036303 Nov 23 07:50:39.025939 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 515/975] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:50:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:50:39.818517 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-97eeada8-f9eb-4da0-adfb-db73d551cc25 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:39.819546 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-97eeada8-f9eb-4da0-adfb-db73d551cc25 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:39.828890 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-97eeada8-f9eb-4da0-adfb-db73d551cc25 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:39.829638 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-97eeada8-f9eb-4da0-adfb-db73d551cc25 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:39.830752 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-97eeada8-f9eb-4da0-adfb-db73d551cc25 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:39.831323 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-97eeada8-f9eb-4da0-adfb-db73d551cc25 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:40.104974 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-97eeada8-f9eb-4da0-adfb-db73d551cc25 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:40.113284 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-97eeada8-f9eb-4da0-adfb-db73d551cc25 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b" status: 200 len: 1318 microversion: 2.1 time: 0.299861 Nov 23 07:50:40.114175 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 461/976] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:39 2021] GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:41.131712 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4dd957b1-f2aa-4a6c-8393-daace6865872 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:41.132415 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4dd957b1-f2aa-4a6c-8393-daace6865872 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:41.139088 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4dd957b1-f2aa-4a6c-8393-daace6865872 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:41.139525 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4dd957b1-f2aa-4a6c-8393-daace6865872 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:41.140904 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4dd957b1-f2aa-4a6c-8393-daace6865872 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:41.141331 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4dd957b1-f2aa-4a6c-8393-daace6865872 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:41.284956 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-4dd957b1-f2aa-4a6c-8393-daace6865872 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:41.293479 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4dd957b1-f2aa-4a6c-8393-daace6865872 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b" status: 200 len: 1318 microversion: 2.1 time: 0.165640 Nov 23 07:50:41.297624 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 516/977] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:41 2021] GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:42.314762 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-708ea838-0bda-41b4-a153-c67859a020c8 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:42.315376 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-708ea838-0bda-41b4-a153-c67859a020c8 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:42.323305 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-708ea838-0bda-41b4-a153-c67859a020c8 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:42.323825 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-708ea838-0bda-41b4-a153-c67859a020c8 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:42.324705 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-708ea838-0bda-41b4-a153-c67859a020c8 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:42.325361 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-708ea838-0bda-41b4-a153-c67859a020c8 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:42.471378 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-708ea838-0bda-41b4-a153-c67859a020c8 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:42.478754 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-708ea838-0bda-41b4-a153-c67859a020c8 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b" status: 200 len: 1318 microversion: 2.1 time: 0.167764 Nov 23 07:50:42.479329 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 462/978] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:42 2021] GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:43.497279 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ee33be75-eca4-48f0-b0e5-cb6ee45354a8 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:43.498530 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ee33be75-eca4-48f0-b0e5-cb6ee45354a8 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:43.505640 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ee33be75-eca4-48f0-b0e5-cb6ee45354a8 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:43.506122 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ee33be75-eca4-48f0-b0e5-cb6ee45354a8 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:43.506922 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ee33be75-eca4-48f0-b0e5-cb6ee45354a8 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:43.507360 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ee33be75-eca4-48f0-b0e5-cb6ee45354a8 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:43.637415 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-6ca003b1-0524-463d-ba86-56b6e165f2b3 req-0818ef94-aa57-4f07-ae6f-27860d50bebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebe5ca4-b941-4d96-9c13-8cbe51b0236b", "name": "network-vif-plugged", "status": "completed", "tag": "99777abd-c894-4087-bb08-0fe3fe38c8c7"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:50:43.640593 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:50:43.640593 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:50:43.654671 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-6ca003b1-0524-463d-ba86-56b6e165f2b3 req-0818ef94-aa57-4f07-ae6f-27860d50bebd service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:43.655835 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-6ca003b1-0524-463d-ba86-56b6e165f2b3 req-0818ef94-aa57-4f07-ae6f-27860d50bebd service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:43.679157 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-6ca003b1-0524-463d-ba86-56b6e165f2b3 req-0818ef94-aa57-4f07-ae6f-27860d50bebd service nova] Creating event network-vif-plugged:99777abd-c894-4087-bb08-0fe3fe38c8c7 for instance 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b on hv-cinder-80403 Nov 23 07:50:43.681779 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ee33be75-eca4-48f0-b0e5-cb6ee45354a8 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:43.689317 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-6ca003b1-0524-463d-ba86-56b6e165f2b3 req-0818ef94-aa57-4f07-ae6f-27860d50bebd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054834 Nov 23 07:50:43.690310 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 463/979] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:50:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:50:43.692236 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ee33be75-eca4-48f0-b0e5-cb6ee45354a8 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b" status: 200 len: 1318 microversion: 2.1 time: 0.198966 Nov 23 07:50:43.692864 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 517/980] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:43 2021] GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:44.710091 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-8da6e4e9-83b6-486d-aabe-7fc634d3ae5a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:44.710788 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-8da6e4e9-83b6-486d-aabe-7fc634d3ae5a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:44.717407 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8da6e4e9-83b6-486d-aabe-7fc634d3ae5a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:44.717895 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8da6e4e9-83b6-486d-aabe-7fc634d3ae5a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:44.718677 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8da6e4e9-83b6-486d-aabe-7fc634d3ae5a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:44.719100 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8da6e4e9-83b6-486d-aabe-7fc634d3ae5a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:44.854760 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-8da6e4e9-83b6-486d-aabe-7fc634d3ae5a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:44.862007 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-8da6e4e9-83b6-486d-aabe-7fc634d3ae5a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b" status: 200 len: 1318 microversion: 2.1 time: 0.155954 Nov 23 07:50:44.862575 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 464/981] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:44 2021] GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:45.878634 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6a9e1fdf-d549-4fec-a102-8eebc4511fdd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:45.879232 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6a9e1fdf-d549-4fec-a102-8eebc4511fdd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:45.885682 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6a9e1fdf-d549-4fec-a102-8eebc4511fdd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:45.886161 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6a9e1fdf-d549-4fec-a102-8eebc4511fdd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:45.886946 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6a9e1fdf-d549-4fec-a102-8eebc4511fdd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:45.887382 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6a9e1fdf-d549-4fec-a102-8eebc4511fdd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:46.027856 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6a9e1fdf-d549-4fec-a102-8eebc4511fdd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:50:46.036585 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6a9e1fdf-d549-4fec-a102-8eebc4511fdd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b" status: 200 len: 1509 microversion: 2.1 time: 0.161533 Nov 23 07:50:46.037164 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 518/982] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:50:45 2021] GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:50:49.474269 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-31ae75ba-3a79-4957-8b04-3951983d9a9f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be6a1013-7a84-4ea2-a42f-7f65954a9008"}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:50:49.475324 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-31ae75ba-3a79-4957-8b04-3951983d9a9f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:49.481274 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-31ae75ba-3a79-4957-8b04-3951983d9a9f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:49.481720 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-31ae75ba-3a79-4957-8b04-3951983d9a9f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:49.482509 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-31ae75ba-3a79-4957-8b04-3951983d9a9f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:49.482936 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-31ae75ba-3a79-4957-8b04-3951983d9a9f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:49.711632 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-31ae75ba-3a79-4957-8b04-3951983d9a9f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "POST /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.241060 Nov 23 07:50:49.712260 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 465/983] 10.222.0.48 () {60 vars in 1322 bytes} [Tue Nov 23 07:50:49 2021] POST /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b/os-volume_attachments => generated 194 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:50:57.208355 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-87c6598c-9d3e-43b1-b9dd-0f6b4539c694 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be6a1013-7a84-4ea2-a42f-7f65954a9008"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:50:57.209402 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-87c6598c-9d3e-43b1-b9dd-0f6b4539c694 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:57.215698 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-87c6598c-9d3e-43b1-b9dd-0f6b4539c694 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:57.216153 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-87c6598c-9d3e-43b1-b9dd-0f6b4539c694 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:57.216924 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-87c6598c-9d3e-43b1-b9dd-0f6b4539c694 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:57.217367 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-87c6598c-9d3e-43b1-b9dd-0f6b4539c694 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:57.291091 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-87c6598c-9d3e-43b1-b9dd-0f6b4539c694 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] HTTP exception thrown: Invalid volume: volume be6a1013-7a84-4ea2-a42f-7f65954a9008 is already attached to instances: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b Nov 23 07:50:57.291709 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-87c6598c-9d3e-43b1-b9dd-0f6b4539c694 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Returning 400 to user: Invalid volume: volume be6a1013-7a84-4ea2-a42f-7f65954a9008 is already attached to instances: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:50:57.292520 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-87c6598c-9d3e-43b1-b9dd-0f6b4539c694 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "POST /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.088008 Nov 23 07:50:57.293052 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 519/984] 10.222.0.48 () {60 vars in 1322 bytes} [Tue Nov 23 07:50:57 2021] POST /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b/os-volume_attachments => generated 174 bytes in 89 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 07:50:57.350399 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-097c14c1-060d-4c9a-a330-8161109b1428 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:57.350985 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-097c14c1-060d-4c9a-a330-8161109b1428 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:57.357776 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-097c14c1-060d-4c9a-a330-8161109b1428 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:57.358724 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-097c14c1-060d-4c9a-a330-8161109b1428 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:57.359503 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-097c14c1-060d-4c9a-a330-8161109b1428 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:57.359932 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-097c14c1-060d-4c9a-a330-8161109b1428 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:57.436182 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.objects.instance [None req-097c14c1-060d-4c9a-a330-8161109b1428 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lazy-loading 'services' on Instance uuid 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b {{(pid=122785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:50:57.502804 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-097c14c1-060d-4c9a-a330-8161109b1428 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b/os-volume_attachments/be6a1013-7a84-4ea2-a42f-7f65954a9008" status: 202 len: 0 microversion: 2.1 time: 0.156416 Nov 23 07:50:57.503413 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 466/985] 10.222.0.48 () {58 vars in 1415 bytes} [Tue Nov 23 07:50:57 2021] DELETE /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b/os-volume_attachments/be6a1013-7a84-4ea2-a42f-7f65954a9008 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:50:57.511744 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-34b6034f-56bf-485d-a96e-561d43b51a8b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:57.512743 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-34b6034f-56bf-485d-a96e-561d43b51a8b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:57.518498 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-34b6034f-56bf-485d-a96e-561d43b51a8b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:57.518949 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-34b6034f-56bf-485d-a96e-561d43b51a8b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:57.519716 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-34b6034f-56bf-485d-a96e-561d43b51a8b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:57.520143 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-34b6034f-56bf-485d-a96e-561d43b51a8b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:57.553375 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-34b6034f-56bf-485d-a96e-561d43b51a8b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045412 Nov 23 07:50:57.553967 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 520/986] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:50:57 2021] GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:50:58.565257 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f6947eb6-b960-429d-976c-308cf46acbb5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:58.566337 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f6947eb6-b960-429d-976c-308cf46acbb5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:58.572544 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f6947eb6-b960-429d-976c-308cf46acbb5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:58.572989 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f6947eb6-b960-429d-976c-308cf46acbb5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:58.573796 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f6947eb6-b960-429d-976c-308cf46acbb5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:58.574230 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f6947eb6-b960-429d-976c-308cf46acbb5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:58.604182 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f6947eb6-b960-429d-976c-308cf46acbb5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043375 Nov 23 07:50:58.604657 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 467/987] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:50:58 2021] GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:50:59.615349 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-12f25d7b-423b-497b-81ac-c3227cac2721 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:50:59.616669 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-12f25d7b-423b-497b-81ac-c3227cac2721 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:50:59.623152 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-12f25d7b-423b-497b-81ac-c3227cac2721 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:59.623602 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-12f25d7b-423b-497b-81ac-c3227cac2721 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:59.624957 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-12f25d7b-423b-497b-81ac-c3227cac2721 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:50:59.625386 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-12f25d7b-423b-497b-81ac-c3227cac2721 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:50:59.655579 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-12f25d7b-423b-497b-81ac-c3227cac2721 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043493 Nov 23 07:50:59.656149 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 521/988] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:50:59 2021] GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:51:00.668300 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-979c60d7-c4e3-466d-9a5d-2c3d51ddf8ce tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:00.669111 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-979c60d7-c4e3-466d-9a5d-2c3d51ddf8ce tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:00.675897 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-979c60d7-c4e3-466d-9a5d-2c3d51ddf8ce tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:00.676342 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-979c60d7-c4e3-466d-9a5d-2c3d51ddf8ce tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:00.677115 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-979c60d7-c4e3-466d-9a5d-2c3d51ddf8ce tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:00.677555 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-979c60d7-c4e3-466d-9a5d-2c3d51ddf8ce tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:00.711423 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-979c60d7-c4e3-466d-9a5d-2c3d51ddf8ce tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046822 Nov 23 07:51:00.712032 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 468/989] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:51:00 2021] GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:51:01.723827 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e574406b-d0fd-402d-b7d3-21d7048b2e3f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:01.724773 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e574406b-d0fd-402d-b7d3-21d7048b2e3f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:01.731208 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e574406b-d0fd-402d-b7d3-21d7048b2e3f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:01.731658 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e574406b-d0fd-402d-b7d3-21d7048b2e3f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:01.732450 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e574406b-d0fd-402d-b7d3-21d7048b2e3f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:01.732889 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e574406b-d0fd-402d-b7d3-21d7048b2e3f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:01.764799 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e574406b-d0fd-402d-b7d3-21d7048b2e3f tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044212 Nov 23 07:51:01.765362 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 522/990] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:51:01 2021] GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 07:51:01.919100 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-8299b7b9-9d76-4edf-b506-bead3d2ba236 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-598852037", "imageRef": "6895b3b6-16b9-4e43-bf1b-c19e73615ca8", "flavorRef": "452", "networks": [{"uuid": "297aaeda-aecc-462b-bd77-2688259c1543"}]}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:51:01.976151 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.network.neutron [None req-8299b7b9-9d76-4edf-b506-bead3d2ba236 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] validate_networks() for [('297aaeda-aecc-462b-bd77-2688259c1543', None, None, None, None, None)] {{(pid=122785) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:51:02.371018 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-8299b7b9-9d76-4edf-b506-bead3d2ba236 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Flavor limits 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:51:02.371447 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-8299b7b9-9d76-4edf-b506-bead3d2ba236 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Image limits 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:51:02.371920 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-8299b7b9-9d76-4edf-b506-bead3d2ba236 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Flavor pref 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:51:02.372332 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-8299b7b9-9d76-4edf-b506-bead3d2ba236 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Image pref 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:51:02.372771 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-8299b7b9-9d76-4edf-b506-bead3d2ba236 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:51:02.382066 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8299b7b9-9d76-4edf-b506-bead3d2ba236 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:02.382512 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8299b7b9-9d76-4edf-b506-bead3d2ba236 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:02.383320 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8299b7b9-9d76-4edf-b506-bead3d2ba236 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:02.383750 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8299b7b9-9d76-4edf-b506-bead3d2ba236 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:02.402119 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-8299b7b9-9d76-4edf-b506-bead3d2ba236 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Getting quotas for project 93c77eb8adee494f8cddcb74d01e7183. Resources: {'instances', 'cores', 'ram'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:51:02.407001 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-8299b7b9-9d76-4edf-b506-bead3d2ba236 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Getting quotas for user 4a32fdae11324218aed54988a2b9ec46 and project 93c77eb8adee494f8cddcb74d01e7183. Resources: {'instances', 'cores', 'ram'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:51:02.422493 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-8299b7b9-9d76-4edf-b506-bead3d2ba236 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Going to run 1 instances... {{(pid=122785) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:51:02.426971 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-8299b7b9-9d76-4edf-b506-bead3d2ba236 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6895b3b6-16b9-4e43-bf1b-c19e73615ca8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:51:02.497103 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-8299b7b9-9d76-4edf-b506-bead3d2ba236 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581670 Nov 23 07:51:02.498053 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 469/991] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Nov 23 07:51:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 07:51:02.508305 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-06600cf0-a4c6-47ac-9223-24938cede728 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:02.509447 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-06600cf0-a4c6-47ac-9223-24938cede728 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:02.567187 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-06600cf0-a4c6-47ac-9223-24938cede728 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:02.574048 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-06600cf0-a4c6-47ac-9223-24938cede728 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1217 microversion: 2.1 time: 0.069454 Nov 23 07:51:02.574635 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 523/992] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:02 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:03.592062 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3745f226-67a8-4da9-85ba-1507fc267e4d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:03.592713 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3745f226-67a8-4da9-85ba-1507fc267e4d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:03.599594 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3745f226-67a8-4da9-85ba-1507fc267e4d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:03.600042 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3745f226-67a8-4da9-85ba-1507fc267e4d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:03.600840 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3745f226-67a8-4da9-85ba-1507fc267e4d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:03.601347 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3745f226-67a8-4da9-85ba-1507fc267e4d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:03.666268 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-3745f226-67a8-4da9-85ba-1507fc267e4d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:03.676141 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3745f226-67a8-4da9-85ba-1507fc267e4d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1221 microversion: 2.1 time: 0.087762 Nov 23 07:51:03.676742 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 470/993] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:03 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1221 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:51:04.693596 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-79dbc970-1d57-45b9-8c41-c8ca5fd7ed0b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:04.694291 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-79dbc970-1d57-45b9-8c41-c8ca5fd7ed0b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:04.701255 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-79dbc970-1d57-45b9-8c41-c8ca5fd7ed0b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:04.702283 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-79dbc970-1d57-45b9-8c41-c8ca5fd7ed0b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:04.703100 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-79dbc970-1d57-45b9-8c41-c8ca5fd7ed0b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:04.703538 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-79dbc970-1d57-45b9-8c41-c8ca5fd7ed0b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:04.772166 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-79dbc970-1d57-45b9-8c41-c8ca5fd7ed0b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:04.784809 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-79dbc970-1d57-45b9-8c41-c8ca5fd7ed0b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1269 microversion: 2.1 time: 0.094718 Nov 23 07:51:04.785424 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 524/994] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:04 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1269 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:05.803158 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5c189024-1c90-4ba4-85a3-5a3824ad1028 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:05.804100 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5c189024-1c90-4ba4-85a3-5a3824ad1028 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:05.812143 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5c189024-1c90-4ba4-85a3-5a3824ad1028 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:05.813509 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5c189024-1c90-4ba4-85a3-5a3824ad1028 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:05.814450 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5c189024-1c90-4ba4-85a3-5a3824ad1028 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:05.814876 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5c189024-1c90-4ba4-85a3-5a3824ad1028 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:06.139588 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5c189024-1c90-4ba4-85a3-5a3824ad1028 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:06.148425 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5c189024-1c90-4ba4-85a3-5a3824ad1028 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1275 microversion: 2.1 time: 0.349654 Nov 23 07:51:06.149047 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 471/995] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:05 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1275 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:51:07.153138 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-7b98db1e-c169-466a-898b-cd1298b7a1ee req-f51e50aa-9ece-40ed-bad5-da176ebe3787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eec45cee-3532-4eee-96c2-3d4cd9b32f5a", "tag": "d57cfa3c-6e3c-4e17-ba1a-750503169678"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:51:07.156328 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:51:07.156328 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:51:07.164884 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-7b98db1e-c169-466a-898b-cd1298b7a1ee req-f51e50aa-9ece-40ed-bad5-da176ebe3787 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:07.165596 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-7b98db1e-c169-466a-898b-cd1298b7a1ee req-f51e50aa-9ece-40ed-bad5-da176ebe3787 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:07.172641 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ea2ab36e-403c-474a-8ff2-c686dd137576 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:07.174167 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ea2ab36e-403c-474a-8ff2-c686dd137576 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:07.193759 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-7b98db1e-c169-466a-898b-cd1298b7a1ee req-f51e50aa-9ece-40ed-bad5-da176ebe3787 service nova] Creating event network-changed:d57cfa3c-6e3c-4e17-ba1a-750503169678 for instance eec45cee-3532-4eee-96c2-3d4cd9b32f5a on hv-cinder-80403 Nov 23 07:51:07.194217 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ea2ab36e-403c-474a-8ff2-c686dd137576 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:07.194737 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ea2ab36e-403c-474a-8ff2-c686dd137576 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:07.195657 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ea2ab36e-403c-474a-8ff2-c686dd137576 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:07.196158 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ea2ab36e-403c-474a-8ff2-c686dd137576 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:07.199408 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-7b98db1e-c169-466a-898b-cd1298b7a1ee req-f51e50aa-9ece-40ed-bad5-da176ebe3787 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050195 Nov 23 07:51:07.203072 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 525/996] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:51:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:51:07.416939 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ea2ab36e-403c-474a-8ff2-c686dd137576 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:07.429882 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ea2ab36e-403c-474a-8ff2-c686dd137576 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1317 microversion: 2.1 time: 0.264069 Nov 23 07:51:07.430993 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 472/997] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:07 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:07.588889 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-195a220a-dae5-4200-bc71-434c7a4a5c86 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:51:07.589409 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-195a220a-dae5-4200-bc71-434c7a4a5c86 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:07.596040 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-195a220a-dae5-4200-bc71-434c7a4a5c86 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:07.596496 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-195a220a-dae5-4200-bc71-434c7a4a5c86 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:07.597301 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-195a220a-dae5-4200-bc71-434c7a4a5c86 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:07.597768 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-195a220a-dae5-4200-bc71-434c7a4a5c86 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:07.623233 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.objects.instance [None req-195a220a-dae5-4200-bc71-434c7a4a5c86 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lazy-loading 'flavor' on Instance uuid 4be38773-5840-4e15-b2f5-ce77caceb858 {{(pid=122786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:51:07.713878 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-195a220a-dae5-4200-bc71-434c7a4a5c86 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "POST /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858/action" status: 202 len: 0 microversion: 2.1 time: 0.129280 Nov 23 07:51:07.714481 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 526/998] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:51:07 2021] POST /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:51:07.726814 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c6f917a6-05a2-4e0e-9e5a-f8095fa187c9 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:07.727952 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c6f917a6-05a2-4e0e-9e5a-f8095fa187c9 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:07.739136 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c6f917a6-05a2-4e0e-9e5a-f8095fa187c9 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:07.739951 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c6f917a6-05a2-4e0e-9e5a-f8095fa187c9 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:07.741418 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c6f917a6-05a2-4e0e-9e5a-f8095fa187c9 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:07.742287 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c6f917a6-05a2-4e0e-9e5a-f8095fa187c9 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:07.908481 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c6f917a6-05a2-4e0e-9e5a-f8095fa187c9 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:07.917274 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c6f917a6-05a2-4e0e-9e5a-f8095fa187c9 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1568 microversion: 2.1 time: 0.197465 Nov 23 07:51:07.917917 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 473/999] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:07 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:08.450479 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-eab87f34-7286-48b1-a02e-aa23933bfe6b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:08.451207 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-eab87f34-7286-48b1-a02e-aa23933bfe6b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:08.458575 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-eab87f34-7286-48b1-a02e-aa23933bfe6b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:08.459024 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-eab87f34-7286-48b1-a02e-aa23933bfe6b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:08.459825 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-eab87f34-7286-48b1-a02e-aa23933bfe6b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:08.460260 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-eab87f34-7286-48b1-a02e-aa23933bfe6b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:08.648961 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-eab87f34-7286-48b1-a02e-aa23933bfe6b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:08.658037 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-eab87f34-7286-48b1-a02e-aa23933bfe6b tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1317 microversion: 2.1 time: 0.212298 Nov 23 07:51:08.658622 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 527/1000] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:08 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:08.935901 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-20566cae-dc7d-4d15-8a8f-0f0990bff479 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:08.937061 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-20566cae-dc7d-4d15-8a8f-0f0990bff479 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:08.943608 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-20566cae-dc7d-4d15-8a8f-0f0990bff479 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:08.944057 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-20566cae-dc7d-4d15-8a8f-0f0990bff479 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:08.944893 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-20566cae-dc7d-4d15-8a8f-0f0990bff479 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:08.945330 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-20566cae-dc7d-4d15-8a8f-0f0990bff479 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:09.104768 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-20566cae-dc7d-4d15-8a8f-0f0990bff479 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:09.114701 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-20566cae-dc7d-4d15-8a8f-0f0990bff479 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1568 microversion: 2.1 time: 0.182277 Nov 23 07:51:09.115333 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 474/1001] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:08 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:51:09.676130 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-94595e71-da5a-4a50-9d29-e8c1dfd5f54e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:09.676743 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-94595e71-da5a-4a50-9d29-e8c1dfd5f54e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:09.683141 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-94595e71-da5a-4a50-9d29-e8c1dfd5f54e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:09.683589 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-94595e71-da5a-4a50-9d29-e8c1dfd5f54e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:09.684365 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-94595e71-da5a-4a50-9d29-e8c1dfd5f54e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:09.684793 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-94595e71-da5a-4a50-9d29-e8c1dfd5f54e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:09.820950 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-94595e71-da5a-4a50-9d29-e8c1dfd5f54e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:09.829286 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-94595e71-da5a-4a50-9d29-e8c1dfd5f54e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1317 microversion: 2.1 time: 0.156985 Nov 23 07:51:09.829906 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 528/1002] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:09 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:51:10.134816 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-046c44e2-38df-4115-8222-2c2023234c04 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:10.135471 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-046c44e2-38df-4115-8222-2c2023234c04 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:10.142572 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-046c44e2-38df-4115-8222-2c2023234c04 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:10.143014 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-046c44e2-38df-4115-8222-2c2023234c04 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:10.143807 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-046c44e2-38df-4115-8222-2c2023234c04 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:10.144232 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-046c44e2-38df-4115-8222-2c2023234c04 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:10.518454 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-046c44e2-38df-4115-8222-2c2023234c04 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:10.529777 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-046c44e2-38df-4115-8222-2c2023234c04 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1568 microversion: 2.1 time: 0.398312 Nov 23 07:51:10.530574 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 475/1003] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:10 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1568 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:10.846246 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6d7a734e-582b-4a58-b482-e19d2d7aff93 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:10.846928 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6d7a734e-582b-4a58-b482-e19d2d7aff93 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:10.853734 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6d7a734e-582b-4a58-b482-e19d2d7aff93 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:10.854188 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6d7a734e-582b-4a58-b482-e19d2d7aff93 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:10.855086 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6d7a734e-582b-4a58-b482-e19d2d7aff93 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:10.855467 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6d7a734e-582b-4a58-b482-e19d2d7aff93 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:11.007203 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6d7a734e-582b-4a58-b482-e19d2d7aff93 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:11.019117 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6d7a734e-582b-4a58-b482-e19d2d7aff93 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1317 microversion: 2.1 time: 0.176661 Nov 23 07:51:11.019909 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 529/1004] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:10 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:11.548722 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3322ecb3-d9a6-49bd-a3bd-ad8004ae6acb tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:11.549658 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3322ecb3-d9a6-49bd-a3bd-ad8004ae6acb tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:11.559827 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3322ecb3-d9a6-49bd-a3bd-ad8004ae6acb tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:11.560310 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3322ecb3-d9a6-49bd-a3bd-ad8004ae6acb tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:11.561972 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3322ecb3-d9a6-49bd-a3bd-ad8004ae6acb tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:11.562421 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3322ecb3-d9a6-49bd-a3bd-ad8004ae6acb tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:11.710665 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-3322ecb3-d9a6-49bd-a3bd-ad8004ae6acb tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:11.719238 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3322ecb3-d9a6-49bd-a3bd-ad8004ae6acb tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1568 microversion: 2.1 time: 0.175606 Nov 23 07:51:11.720089 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 476/1005] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:11 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:12.037398 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-41b97100-6ae4-47d8-970f-5a21c92f6003 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:12.038058 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-41b97100-6ae4-47d8-970f-5a21c92f6003 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:12.044994 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-41b97100-6ae4-47d8-970f-5a21c92f6003 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:12.045492 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-41b97100-6ae4-47d8-970f-5a21c92f6003 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:12.046334 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-41b97100-6ae4-47d8-970f-5a21c92f6003 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:12.046772 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-41b97100-6ae4-47d8-970f-5a21c92f6003 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:12.196106 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-41b97100-6ae4-47d8-970f-5a21c92f6003 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:12.204549 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-41b97100-6ae4-47d8-970f-5a21c92f6003 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1317 microversion: 2.1 time: 0.171079 Nov 23 07:51:12.205149 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 530/1006] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:12 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:51:12.737458 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-e2770344-e12c-48b9-b6cc-8a7e8f796fff tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:12.738149 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-e2770344-e12c-48b9-b6cc-8a7e8f796fff tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:12.745275 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e2770344-e12c-48b9-b6cc-8a7e8f796fff tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:12.745852 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e2770344-e12c-48b9-b6cc-8a7e8f796fff tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:12.746798 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e2770344-e12c-48b9-b6cc-8a7e8f796fff tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:12.747297 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e2770344-e12c-48b9-b6cc-8a7e8f796fff tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:12.902534 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-e2770344-e12c-48b9-b6cc-8a7e8f796fff tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:12.911221 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-e2770344-e12c-48b9-b6cc-8a7e8f796fff tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1568 microversion: 2.1 time: 0.177811 Nov 23 07:51:12.911960 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 477/1007] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:12 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:13.221180 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d2ad1fee-a15d-443a-bc02-2fc82b50fb0e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:13.221935 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d2ad1fee-a15d-443a-bc02-2fc82b50fb0e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:13.228938 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d2ad1fee-a15d-443a-bc02-2fc82b50fb0e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:13.229392 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d2ad1fee-a15d-443a-bc02-2fc82b50fb0e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:13.230249 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d2ad1fee-a15d-443a-bc02-2fc82b50fb0e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:13.230693 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d2ad1fee-a15d-443a-bc02-2fc82b50fb0e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:13.387353 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d2ad1fee-a15d-443a-bc02-2fc82b50fb0e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:13.396046 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d2ad1fee-a15d-443a-bc02-2fc82b50fb0e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1317 microversion: 2.1 time: 0.178588 Nov 23 07:51:13.396632 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 531/1008] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:13 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:13.934076 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-62cf6090-64dc-4c02-81c8-fae40905e2ae tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:13.935135 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-62cf6090-64dc-4c02-81c8-fae40905e2ae tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:13.944851 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-62cf6090-64dc-4c02-81c8-fae40905e2ae tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:13.945435 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-62cf6090-64dc-4c02-81c8-fae40905e2ae tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:13.946298 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-62cf6090-64dc-4c02-81c8-fae40905e2ae tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:13.946802 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-62cf6090-64dc-4c02-81c8-fae40905e2ae tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:14.131410 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-62cf6090-64dc-4c02-81c8-fae40905e2ae tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:14.141352 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-62cf6090-64dc-4c02-81c8-fae40905e2ae tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1568 microversion: 2.1 time: 0.214211 Nov 23 07:51:14.142001 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 478/1009] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:13 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:14.415434 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-9f730c8f-d472-4703-b278-009cc93dded2 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:14.416064 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-9f730c8f-d472-4703-b278-009cc93dded2 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:14.423748 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9f730c8f-d472-4703-b278-009cc93dded2 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:14.424203 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9f730c8f-d472-4703-b278-009cc93dded2 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:14.425019 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9f730c8f-d472-4703-b278-009cc93dded2 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:14.425466 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9f730c8f-d472-4703-b278-009cc93dded2 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:14.576744 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-9f730c8f-d472-4703-b278-009cc93dded2 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:14.585493 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-9f730c8f-d472-4703-b278-009cc93dded2 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1317 microversion: 2.1 time: 0.173637 Nov 23 07:51:14.586153 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 532/1010] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:14 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:15.171821 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-2bfb01ac-1885-4b02-a490-015bb15b65ce tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:15.173015 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-2bfb01ac-1885-4b02-a490-015bb15b65ce tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:15.183647 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2bfb01ac-1885-4b02-a490-015bb15b65ce tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:15.184438 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2bfb01ac-1885-4b02-a490-015bb15b65ce tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:15.185907 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2bfb01ac-1885-4b02-a490-015bb15b65ce tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:15.187468 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-2bfb01ac-1885-4b02-a490-015bb15b65ce tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:15.340972 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-2bfb01ac-1885-4b02-a490-015bb15b65ce tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:15.348813 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-2bfb01ac-1885-4b02-a490-015bb15b65ce tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1568 microversion: 2.1 time: 0.184376 Nov 23 07:51:15.349420 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 479/1011] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:15 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:15.610208 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-2178c4bb-c0ea-4e74-a64f-baacc9074f54 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:15.610762 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-2178c4bb-c0ea-4e74-a64f-baacc9074f54 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:15.616944 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2178c4bb-c0ea-4e74-a64f-baacc9074f54 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:15.617382 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2178c4bb-c0ea-4e74-a64f-baacc9074f54 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:15.618194 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2178c4bb-c0ea-4e74-a64f-baacc9074f54 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:15.618624 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2178c4bb-c0ea-4e74-a64f-baacc9074f54 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:15.748606 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-2178c4bb-c0ea-4e74-a64f-baacc9074f54 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:15.755927 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-2178c4bb-c0ea-4e74-a64f-baacc9074f54 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1317 microversion: 2.1 time: 0.150152 Nov 23 07:51:15.756509 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 533/1012] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:15 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:16.371795 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3e900401-5a6a-4322-86ba-3090e672f074 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:16.372823 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3e900401-5a6a-4322-86ba-3090e672f074 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:16.382486 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3e900401-5a6a-4322-86ba-3090e672f074 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:16.383000 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3e900401-5a6a-4322-86ba-3090e672f074 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:16.383875 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3e900401-5a6a-4322-86ba-3090e672f074 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:16.384359 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3e900401-5a6a-4322-86ba-3090e672f074 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:16.559318 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-3e900401-5a6a-4322-86ba-3090e672f074 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:16.573238 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3e900401-5a6a-4322-86ba-3090e672f074 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1568 microversion: 2.1 time: 0.208816 Nov 23 07:51:16.574209 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 480/1013] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:16 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:16.776680 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-9946c4da-c518-4973-8636-ca324373798a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:16.777904 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-9946c4da-c518-4973-8636-ca324373798a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:16.787006 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9946c4da-c518-4973-8636-ca324373798a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:16.787506 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9946c4da-c518-4973-8636-ca324373798a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:16.788309 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9946c4da-c518-4973-8636-ca324373798a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:16.788749 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-9946c4da-c518-4973-8636-ca324373798a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:16.962087 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-9946c4da-c518-4973-8636-ca324373798a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:16.970546 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-9946c4da-c518-4973-8636-ca324373798a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1317 microversion: 2.1 time: 0.200067 Nov 23 07:51:16.971566 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 534/1014] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:16 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:17.591234 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-6a244a3b-d545-4ab9-89c6-5e1726b09df3 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:17.591840 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-6a244a3b-d545-4ab9-89c6-5e1726b09df3 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:17.598584 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6a244a3b-d545-4ab9-89c6-5e1726b09df3 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:17.599038 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6a244a3b-d545-4ab9-89c6-5e1726b09df3 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:17.599843 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6a244a3b-d545-4ab9-89c6-5e1726b09df3 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:17.600278 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-6a244a3b-d545-4ab9-89c6-5e1726b09df3 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:17.751999 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-6a244a3b-d545-4ab9-89c6-5e1726b09df3 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:17.760094 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-6a244a3b-d545-4ab9-89c6-5e1726b09df3 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1568 microversion: 2.1 time: 0.172521 Nov 23 07:51:17.760686 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 481/1015] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:17 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:17.989029 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-e4c98f6a-2364-429f-ab88-3230daf4c413 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:17.989789 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-e4c98f6a-2364-429f-ab88-3230daf4c413 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:17.996801 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e4c98f6a-2364-429f-ab88-3230daf4c413 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:17.997398 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e4c98f6a-2364-429f-ab88-3230daf4c413 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:17.998350 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e4c98f6a-2364-429f-ab88-3230daf4c413 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:17.998881 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-e4c98f6a-2364-429f-ab88-3230daf4c413 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:18.115452 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-801f6d56-b53c-4585-9f89-f2ea1b1309f4 req-44b40384-1456-45c1-b656-80c35beedade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec45cee-3532-4eee-96c2-3d4cd9b32f5a", "name": "network-vif-plugged", "status": "completed", "tag": "d57cfa3c-6e3c-4e17-ba1a-750503169678"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:51:18.117209 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:51:18.117209 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:51:18.129087 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-801f6d56-b53c-4585-9f89-f2ea1b1309f4 req-44b40384-1456-45c1-b656-80c35beedade service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:18.129604 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-801f6d56-b53c-4585-9f89-f2ea1b1309f4 req-44b40384-1456-45c1-b656-80c35beedade service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:18.144992 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-801f6d56-b53c-4585-9f89-f2ea1b1309f4 req-44b40384-1456-45c1-b656-80c35beedade service nova] Creating event network-vif-plugged:d57cfa3c-6e3c-4e17-ba1a-750503169678 for instance eec45cee-3532-4eee-96c2-3d4cd9b32f5a on hv-cinder-80403 Nov 23 07:51:18.152265 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-801f6d56-b53c-4585-9f89-f2ea1b1309f4 req-44b40384-1456-45c1-b656-80c35beedade service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041083 Nov 23 07:51:18.153145 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 482/1016] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:51:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:51:18.253109 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-e4c98f6a-2364-429f-ab88-3230daf4c413 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:18.261634 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-e4c98f6a-2364-429f-ab88-3230daf4c413 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1317 microversion: 2.1 time: 0.276277 Nov 23 07:51:18.262568 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 535/1017] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:17 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:51:18.778220 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-8438c01e-344b-4d94-811a-a1307e46aead tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:18.778917 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-8438c01e-344b-4d94-811a-a1307e46aead tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:18.785668 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8438c01e-344b-4d94-811a-a1307e46aead tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:18.786147 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8438c01e-344b-4d94-811a-a1307e46aead tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:18.786944 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8438c01e-344b-4d94-811a-a1307e46aead tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:18.787371 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8438c01e-344b-4d94-811a-a1307e46aead tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:18.927316 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-8438c01e-344b-4d94-811a-a1307e46aead tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:18.938575 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-8438c01e-344b-4d94-811a-a1307e46aead tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1568 microversion: 2.1 time: 0.164333 Nov 23 07:51:18.939591 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 483/1018] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:18 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:19.285132 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-72221f7b-020d-445e-9dc2-7b667606c5f0 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:19.285822 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-72221f7b-020d-445e-9dc2-7b667606c5f0 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:19.292161 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-72221f7b-020d-445e-9dc2-7b667606c5f0 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:19.292621 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-72221f7b-020d-445e-9dc2-7b667606c5f0 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:19.293422 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-72221f7b-020d-445e-9dc2-7b667606c5f0 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:19.293885 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-72221f7b-020d-445e-9dc2-7b667606c5f0 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:19.425315 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-72221f7b-020d-445e-9dc2-7b667606c5f0 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:19.432701 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-72221f7b-020d-445e-9dc2-7b667606c5f0 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1317 microversion: 2.1 time: 0.151519 Nov 23 07:51:19.433273 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 536/1019] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:19 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:19.956218 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-b56ddc9f-e9d9-4986-89d8-51291a5e6f73 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:19.956821 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-b56ddc9f-e9d9-4986-89d8-51291a5e6f73 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:19.963169 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b56ddc9f-e9d9-4986-89d8-51291a5e6f73 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:19.963617 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b56ddc9f-e9d9-4986-89d8-51291a5e6f73 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:19.964392 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b56ddc9f-e9d9-4986-89d8-51291a5e6f73 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:19.964822 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b56ddc9f-e9d9-4986-89d8-51291a5e6f73 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:20.114448 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-b56ddc9f-e9d9-4986-89d8-51291a5e6f73 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:20.122266 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-b56ddc9f-e9d9-4986-89d8-51291a5e6f73 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1568 microversion: 2.1 time: 0.169611 Nov 23 07:51:20.122854 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 484/1020] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:19 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:51:20.450464 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6b440896-b7e1-48d5-9139-869f1474f5bc tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:20.451073 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6b440896-b7e1-48d5-9139-869f1474f5bc tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:20.457835 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6b440896-b7e1-48d5-9139-869f1474f5bc tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:20.458290 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6b440896-b7e1-48d5-9139-869f1474f5bc tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:20.459163 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6b440896-b7e1-48d5-9139-869f1474f5bc tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:20.459792 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6b440896-b7e1-48d5-9139-869f1474f5bc tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:20.624695 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6b440896-b7e1-48d5-9139-869f1474f5bc tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:20.632773 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6b440896-b7e1-48d5-9139-869f1474f5bc tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1317 microversion: 2.1 time: 0.186351 Nov 23 07:51:20.633353 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 537/1021] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:20 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:21.140184 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3d6320d2-f3a0-45c1-82ca-0c660c450626 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:21.140792 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3d6320d2-f3a0-45c1-82ca-0c660c450626 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:21.147114 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3d6320d2-f3a0-45c1-82ca-0c660c450626 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:21.147569 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3d6320d2-f3a0-45c1-82ca-0c660c450626 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:21.148345 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3d6320d2-f3a0-45c1-82ca-0c660c450626 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:21.148779 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3d6320d2-f3a0-45c1-82ca-0c660c450626 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:21.290848 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-3d6320d2-f3a0-45c1-82ca-0c660c450626 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:21.298179 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3d6320d2-f3a0-45c1-82ca-0c660c450626 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1568 microversion: 2.1 time: 0.161762 Nov 23 07:51:21.298744 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 485/1022] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:21 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:21.651381 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1e8059e5-4e83-43b5-aecd-3c38ba4174cd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:21.652022 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1e8059e5-4e83-43b5-aecd-3c38ba4174cd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:21.660414 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e8059e5-4e83-43b5-aecd-3c38ba4174cd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:21.660919 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e8059e5-4e83-43b5-aecd-3c38ba4174cd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:21.661733 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e8059e5-4e83-43b5-aecd-3c38ba4174cd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:21.662267 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1e8059e5-4e83-43b5-aecd-3c38ba4174cd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:21.803109 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1e8059e5-4e83-43b5-aecd-3c38ba4174cd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:21.810758 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1e8059e5-4e83-43b5-aecd-3c38ba4174cd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1317 microversion: 2.1 time: 0.163857 Nov 23 07:51:21.812195 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 538/1023] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:21 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:22.316401 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-41ab8508-e89f-4bae-b83a-540f54f4d17d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:22.317001 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-41ab8508-e89f-4bae-b83a-540f54f4d17d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:22.323348 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-41ab8508-e89f-4bae-b83a-540f54f4d17d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:22.323786 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-41ab8508-e89f-4bae-b83a-540f54f4d17d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:22.324550 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-41ab8508-e89f-4bae-b83a-540f54f4d17d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:22.324974 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-41ab8508-e89f-4bae-b83a-540f54f4d17d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:22.468109 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-41ab8508-e89f-4bae-b83a-540f54f4d17d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:22.478925 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-41ab8508-e89f-4bae-b83a-540f54f4d17d tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1568 microversion: 2.1 time: 0.165237 Nov 23 07:51:22.484674 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 486/1024] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:22 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:22.829840 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-0b53fb2a-1b36-4fe9-81a8-602b1f07516d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:22.830554 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-0b53fb2a-1b36-4fe9-81a8-602b1f07516d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:22.838121 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0b53fb2a-1b36-4fe9-81a8-602b1f07516d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:22.838565 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0b53fb2a-1b36-4fe9-81a8-602b1f07516d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:22.839348 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0b53fb2a-1b36-4fe9-81a8-602b1f07516d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:22.839779 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0b53fb2a-1b36-4fe9-81a8-602b1f07516d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:22.995704 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-0b53fb2a-1b36-4fe9-81a8-602b1f07516d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:23.004104 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-0b53fb2a-1b36-4fe9-81a8-602b1f07516d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1507 microversion: 2.1 time: 0.179251 Nov 23 07:51:23.004680 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 539/1025] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:22 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:23.495134 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-1e598f7c-6821-411e-90c5-703bb9adcf40 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:23.495762 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-1e598f7c-6821-411e-90c5-703bb9adcf40 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:23.502637 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1e598f7c-6821-411e-90c5-703bb9adcf40 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:23.503078 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1e598f7c-6821-411e-90c5-703bb9adcf40 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:23.503840 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1e598f7c-6821-411e-90c5-703bb9adcf40 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:23.504267 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1e598f7c-6821-411e-90c5-703bb9adcf40 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:23.650431 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-1e598f7c-6821-411e-90c5-703bb9adcf40 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:23.664195 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-1e598f7c-6821-411e-90c5-703bb9adcf40 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1568 microversion: 2.1 time: 0.172595 Nov 23 07:51:23.664785 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 487/1026] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:23 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:24.373939 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-69454ffe-24a6-48d0-a174-2e76d3b40885 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a4fda45-fdc8-401e-93fd-7da5f596660e"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:51:24.375008 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-69454ffe-24a6-48d0-a174-2e76d3b40885 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:24.381343 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-69454ffe-24a6-48d0-a174-2e76d3b40885 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:24.381839 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-69454ffe-24a6-48d0-a174-2e76d3b40885 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:24.382631 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-69454ffe-24a6-48d0-a174-2e76d3b40885 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:24.383071 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-69454ffe-24a6-48d0-a174-2e76d3b40885 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:24.630562 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-69454ffe-24a6-48d0-a174-2e76d3b40885 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "POST /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260791 Nov 23 07:51:24.631199 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 540/1027] 10.222.0.48 () {60 vars in 1322 bytes} [Tue Nov 23 07:51:24 2021] POST /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:51:24.682066 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-8cef814a-f230-4bd8-a954-27b9ebf7ac2f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:24.682668 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-8cef814a-f230-4bd8-a954-27b9ebf7ac2f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:24.689462 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8cef814a-f230-4bd8-a954-27b9ebf7ac2f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:24.689927 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8cef814a-f230-4bd8-a954-27b9ebf7ac2f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:24.690695 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8cef814a-f230-4bd8-a954-27b9ebf7ac2f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:24.691158 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8cef814a-f230-4bd8-a954-27b9ebf7ac2f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:24.838293 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-8cef814a-f230-4bd8-a954-27b9ebf7ac2f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:24.846058 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-8cef814a-f230-4bd8-a954-27b9ebf7ac2f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1568 microversion: 2.1 time: 0.167471 Nov 23 07:51:24.846640 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 488/1028] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:24 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:25.864817 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-3a059f4a-c15f-4fcc-83e8-9d23549be03e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:25.865515 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-3a059f4a-c15f-4fcc-83e8-9d23549be03e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:25.872130 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3a059f4a-c15f-4fcc-83e8-9d23549be03e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:25.872577 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3a059f4a-c15f-4fcc-83e8-9d23549be03e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:25.873973 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3a059f4a-c15f-4fcc-83e8-9d23549be03e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:25.874424 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3a059f4a-c15f-4fcc-83e8-9d23549be03e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:26.021426 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-3a059f4a-c15f-4fcc-83e8-9d23549be03e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:26.029176 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-3a059f4a-c15f-4fcc-83e8-9d23549be03e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1568 microversion: 2.1 time: 0.168733 Nov 23 07:51:26.030294 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 541/1029] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:25 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:27.047384 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-bfd6b234-3b43-404c-a3ef-ca4c08b89fa0 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:27.048267 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-bfd6b234-3b43-404c-a3ef-ca4c08b89fa0 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:27.057142 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bfd6b234-3b43-404c-a3ef-ca4c08b89fa0 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:27.061373 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bfd6b234-3b43-404c-a3ef-ca4c08b89fa0 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:27.062311 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bfd6b234-3b43-404c-a3ef-ca4c08b89fa0 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:27.062773 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-bfd6b234-3b43-404c-a3ef-ca4c08b89fa0 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:27.265980 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-bfd6b234-3b43-404c-a3ef-ca4c08b89fa0 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:27.274159 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-bfd6b234-3b43-404c-a3ef-ca4c08b89fa0 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1568 microversion: 2.1 time: 0.230257 Nov 23 07:51:27.274664 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 489/1030] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:27 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:28.291205 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-7be0fee7-bb6a-4b2f-8ee1-b0fe9974dcd1 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:28.291818 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-7be0fee7-bb6a-4b2f-8ee1-b0fe9974dcd1 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:28.299317 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7be0fee7-bb6a-4b2f-8ee1-b0fe9974dcd1 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:28.301916 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7be0fee7-bb6a-4b2f-8ee1-b0fe9974dcd1 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:28.301916 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7be0fee7-bb6a-4b2f-8ee1-b0fe9974dcd1 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:28.301916 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7be0fee7-bb6a-4b2f-8ee1-b0fe9974dcd1 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:28.459297 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-7be0fee7-bb6a-4b2f-8ee1-b0fe9974dcd1 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:28.466758 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-7be0fee7-bb6a-4b2f-8ee1-b0fe9974dcd1 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1568 microversion: 2.1 time: 0.179146 Nov 23 07:51:28.467568 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 542/1031] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:28 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:29.486365 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c489ce7d-2d20-4c03-98b5-45c3fee8cc0b tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:29.487128 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c489ce7d-2d20-4c03-98b5-45c3fee8cc0b tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:29.493254 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c489ce7d-2d20-4c03-98b5-45c3fee8cc0b tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:29.493727 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c489ce7d-2d20-4c03-98b5-45c3fee8cc0b tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:29.494516 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c489ce7d-2d20-4c03-98b5-45c3fee8cc0b tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:29.494949 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c489ce7d-2d20-4c03-98b5-45c3fee8cc0b tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:29.647049 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c489ce7d-2d20-4c03-98b5-45c3fee8cc0b tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:29.656531 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c489ce7d-2d20-4c03-98b5-45c3fee8cc0b tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1569 microversion: 2.1 time: 0.175015 Nov 23 07:51:29.657110 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 490/1032] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:29 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:29.673877 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-01215e70-50e9-4c46-ace5-7aea9e80b24f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:51:29.674657 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-01215e70-50e9-4c46-ace5-7aea9e80b24f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:29.680710 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-01215e70-50e9-4c46-ace5-7aea9e80b24f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:29.681153 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-01215e70-50e9-4c46-ace5-7aea9e80b24f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:29.681951 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-01215e70-50e9-4c46-ace5-7aea9e80b24f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:29.682377 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-01215e70-50e9-4c46-ace5-7aea9e80b24f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:29.763060 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-01215e70-50e9-4c46-ace5-7aea9e80b24f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "POST /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858/action" status: 202 len: 0 microversion: 2.1 time: 0.093460 Nov 23 07:51:29.768789 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 543/1033] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Nov 23 07:51:29 2021] POST /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:51:29.776242 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-8c497419-9b1d-4170-b57c-4363a72aa060 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:29.776621 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-8c497419-9b1d-4170-b57c-4363a72aa060 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:29.786526 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8c497419-9b1d-4170-b57c-4363a72aa060 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:29.787291 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8c497419-9b1d-4170-b57c-4363a72aa060 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:29.788674 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8c497419-9b1d-4170-b57c-4363a72aa060 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:29.789090 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8c497419-9b1d-4170-b57c-4363a72aa060 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:29.985278 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-8c497419-9b1d-4170-b57c-4363a72aa060 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:29.993497 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-8c497419-9b1d-4170-b57c-4363a72aa060 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1517 microversion: 2.1 time: 0.223161 Nov 23 07:51:29.994491 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 491/1034] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:29 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1517 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:31.011132 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1a90482a-5513-4fee-998a-acf1189cff4b tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:31.012648 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1a90482a-5513-4fee-998a-acf1189cff4b tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:31.033048 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1a90482a-5513-4fee-998a-acf1189cff4b tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:31.033486 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1a90482a-5513-4fee-998a-acf1189cff4b tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:31.034850 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1a90482a-5513-4fee-998a-acf1189cff4b tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:31.035540 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1a90482a-5513-4fee-998a-acf1189cff4b tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:31.226236 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1a90482a-5513-4fee-998a-acf1189cff4b tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:31.233861 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1a90482a-5513-4fee-998a-acf1189cff4b tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1519 microversion: 2.1 time: 0.226704 Nov 23 07:51:31.234576 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 544/1035] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:31 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:32.062738 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-498006c8-255e-4a64-9291-a745bdf1807c req-a57bf63d-d2e1-4b5f-81c3-7851d3f0eec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be38773-5840-4e15-b2f5-ce77caceb858", "name": "network-vif-unplugged", "status": "completed", "tag": "a7bd6f41-4ac3-41e3-8d6f-dd2993595bc7"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:51:32.065055 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:51:32.065055 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:51:32.073933 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-498006c8-255e-4a64-9291-a745bdf1807c req-a57bf63d-d2e1-4b5f-81c3-7851d3f0eec3 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:32.074382 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-498006c8-255e-4a64-9291-a745bdf1807c req-a57bf63d-d2e1-4b5f-81c3-7851d3f0eec3 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:32.091293 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-498006c8-255e-4a64-9291-a745bdf1807c req-a57bf63d-d2e1-4b5f-81c3-7851d3f0eec3 service nova] Creating event network-vif-unplugged:a7bd6f41-4ac3-41e3-8d6f-dd2993595bc7 for instance 4be38773-5840-4e15-b2f5-ce77caceb858 on hv-cinder-80403 Nov 23 07:51:32.097159 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-498006c8-255e-4a64-9291-a745bdf1807c req-a57bf63d-d2e1-4b5f-81c3-7851d3f0eec3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040049 Nov 23 07:51:32.098515 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 492/1036] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:51:32 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:51:32.252756 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c0c2ac5c-e36b-4842-b908-456730a5dd83 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:32.253367 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c0c2ac5c-e36b-4842-b908-456730a5dd83 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:32.264102 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c0c2ac5c-e36b-4842-b908-456730a5dd83 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:32.264514 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c0c2ac5c-e36b-4842-b908-456730a5dd83 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:32.265301 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c0c2ac5c-e36b-4842-b908-456730a5dd83 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:32.265823 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c0c2ac5c-e36b-4842-b908-456730a5dd83 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:32.312674 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f68a6af8-7383-4c4e-93d6-aa83860c8159 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:32.313362 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f68a6af8-7383-4c4e-93d6-aa83860c8159 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:32.320023 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f68a6af8-7383-4c4e-93d6-aa83860c8159 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:32.321016 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f68a6af8-7383-4c4e-93d6-aa83860c8159 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:32.321930 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f68a6af8-7383-4c4e-93d6-aa83860c8159 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:32.322428 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f68a6af8-7383-4c4e-93d6-aa83860c8159 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:32.407022 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.objects.instance [None req-f68a6af8-7383-4c4e-93d6-aa83860c8159 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lazy-loading 'services' on Instance uuid eec45cee-3532-4eee-96c2-3d4cd9b32f5a {{(pid=122785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:51:32.418849 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-c0c2ac5c-e36b-4842-b908-456730a5dd83 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:32.427348 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c0c2ac5c-e36b-4842-b908-456730a5dd83 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1575 microversion: 2.1 time: 0.179173 Nov 23 07:51:32.427925 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 545/1037] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:32 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:32.476595 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f68a6af8-7383-4c4e-93d6-aa83860c8159 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "DELETE /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a/os-volume_attachments/9a4fda45-fdc8-401e-93fd-7da5f596660e" status: 202 len: 0 microversion: 2.1 time: 0.168784 Nov 23 07:51:32.477250 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 493/1038] 10.222.0.48 () {58 vars in 1415 bytes} [Tue Nov 23 07:51:32 2021] DELETE /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a/os-volume_attachments/9a4fda45-fdc8-401e-93fd-7da5f596660e => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:51:32.495105 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-651ba3fb-9a83-48c0-8b70-06dd4f45455a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:32.496787 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-651ba3fb-9a83-48c0-8b70-06dd4f45455a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:32.506533 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-651ba3fb-9a83-48c0-8b70-06dd4f45455a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:32.508435 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-651ba3fb-9a83-48c0-8b70-06dd4f45455a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:32.510982 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-651ba3fb-9a83-48c0-8b70-06dd4f45455a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:32.512355 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-651ba3fb-9a83-48c0-8b70-06dd4f45455a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:32.581639 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-651ba3fb-9a83-48c0-8b70-06dd4f45455a tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093701 Nov 23 07:51:32.582621 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 546/1039] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:51:32 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:51:33.445334 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-e0b2e285-01b4-4b71-a18b-32547d10853f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:33.446064 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-e0b2e285-01b4-4b71-a18b-32547d10853f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:33.452634 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e0b2e285-01b4-4b71-a18b-32547d10853f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:33.453112 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e0b2e285-01b4-4b71-a18b-32547d10853f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:33.453899 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e0b2e285-01b4-4b71-a18b-32547d10853f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:33.454326 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e0b2e285-01b4-4b71-a18b-32547d10853f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:33.596559 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1a9beb8d-6f98-4058-94a5-48c76652a493 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:33.597456 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1a9beb8d-6f98-4058-94a5-48c76652a493 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:33.597950 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-e0b2e285-01b4-4b71-a18b-32547d10853f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:33.603889 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1a9beb8d-6f98-4058-94a5-48c76652a493 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:33.604336 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1a9beb8d-6f98-4058-94a5-48c76652a493 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:33.605114 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1a9beb8d-6f98-4058-94a5-48c76652a493 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:33.605486 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-e0b2e285-01b4-4b71-a18b-32547d10853f tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1575 microversion: 2.1 time: 0.164679 Nov 23 07:51:33.605591 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1a9beb8d-6f98-4058-94a5-48c76652a493 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:33.606104 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 494/1040] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:33 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:33.636657 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1a9beb8d-6f98-4058-94a5-48c76652a493 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044554 Nov 23 07:51:33.637202 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 547/1041] 10.222.0.48 () {58 vars in 1301 bytes} [Tue Nov 23 07:51:33 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 07:51:34.623280 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-05ee6f9b-63c7-4bbf-b0e6-55b365b3e8dc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:34.623888 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-05ee6f9b-63c7-4bbf-b0e6-55b365b3e8dc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:34.630847 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-05ee6f9b-63c7-4bbf-b0e6-55b365b3e8dc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:34.631290 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-05ee6f9b-63c7-4bbf-b0e6-55b365b3e8dc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:34.632492 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-05ee6f9b-63c7-4bbf-b0e6-55b365b3e8dc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:34.633068 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-05ee6f9b-63c7-4bbf-b0e6-55b365b3e8dc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:34.772416 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-05ee6f9b-63c7-4bbf-b0e6-55b365b3e8dc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:34.780432 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-05ee6f9b-63c7-4bbf-b0e6-55b365b3e8dc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1575 microversion: 2.1 time: 0.161276 Nov 23 07:51:34.781011 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 495/1042] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:34 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:34.827805 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a1b967f8-9da6-4e0d-9ab1-ecd33848f3d7 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:34.828900 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a1b967f8-9da6-4e0d-9ab1-ecd33848f3d7 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:34.835690 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a1b967f8-9da6-4e0d-9ab1-ecd33848f3d7 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:34.842045 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a1b967f8-9da6-4e0d-9ab1-ecd33848f3d7 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:34.842045 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a1b967f8-9da6-4e0d-9ab1-ecd33848f3d7 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:34.842045 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a1b967f8-9da6-4e0d-9ab1-ecd33848f3d7 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:34.885035 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a1b967f8-9da6-4e0d-9ab1-ecd33848f3d7 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Going to try to terminate instance {{(pid=122786) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:51:34.972226 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a1b967f8-9da6-4e0d-9ab1-ecd33848f3d7 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "DELETE /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 204 len: 0 microversion: 2.1 time: 0.148748 Nov 23 07:51:34.973200 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 548/1043] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:51:34 2021] DELETE /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 07:51:34.988079 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-923c3663-e6bc-4fc4-a81f-78dd4456b843 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:34.988919 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-923c3663-e6bc-4fc4-a81f-78dd4456b843 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:35.003631 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-923c3663-e6bc-4fc4-a81f-78dd4456b843 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:35.005246 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-923c3663-e6bc-4fc4-a81f-78dd4456b843 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:35.006731 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-923c3663-e6bc-4fc4-a81f-78dd4456b843 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:35.007508 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-923c3663-e6bc-4fc4-a81f-78dd4456b843 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:35.153387 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-923c3663-e6bc-4fc4-a81f-78dd4456b843 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:35.161190 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-923c3663-e6bc-4fc4-a81f-78dd4456b843 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1513 microversion: 2.1 time: 0.182734 Nov 23 07:51:35.161790 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 496/1044] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:34 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:35.799572 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-906795f5-5456-4b85-9ac5-05f6c878d1cc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:35.800372 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-906795f5-5456-4b85-9ac5-05f6c878d1cc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:35.807160 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-906795f5-5456-4b85-9ac5-05f6c878d1cc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:35.807610 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-906795f5-5456-4b85-9ac5-05f6c878d1cc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:35.808534 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-906795f5-5456-4b85-9ac5-05f6c878d1cc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:35.808876 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-906795f5-5456-4b85-9ac5-05f6c878d1cc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:35.948492 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-906795f5-5456-4b85-9ac5-05f6c878d1cc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:35.956104 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-906795f5-5456-4b85-9ac5-05f6c878d1cc tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1575 microversion: 2.1 time: 0.161618 Nov 23 07:51:35.956698 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 549/1045] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:35 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:36.178872 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c38ac29b-bc0f-4f89-b683-9ccd3c740362 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:36.180685 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c38ac29b-bc0f-4f89-b683-9ccd3c740362 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:36.187522 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c38ac29b-bc0f-4f89-b683-9ccd3c740362 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:36.187990 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c38ac29b-bc0f-4f89-b683-9ccd3c740362 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:36.188834 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c38ac29b-bc0f-4f89-b683-9ccd3c740362 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:36.189231 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c38ac29b-bc0f-4f89-b683-9ccd3c740362 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:36.335199 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c38ac29b-bc0f-4f89-b683-9ccd3c740362 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:36.347133 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c38ac29b-bc0f-4f89-b683-9ccd3c740362 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1513 microversion: 2.1 time: 0.169713 Nov 23 07:51:36.348020 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 497/1046] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:36 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:36.973587 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-97a7d182-a868-4f59-9bea-819695f1db1e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:36.974201 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-97a7d182-a868-4f59-9bea-819695f1db1e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:36.980383 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-97a7d182-a868-4f59-9bea-819695f1db1e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:36.980764 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-97a7d182-a868-4f59-9bea-819695f1db1e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:36.981544 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-97a7d182-a868-4f59-9bea-819695f1db1e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:36.982014 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-97a7d182-a868-4f59-9bea-819695f1db1e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:37.131289 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-97a7d182-a868-4f59-9bea-819695f1db1e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:37.140350 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-97a7d182-a868-4f59-9bea-819695f1db1e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1575 microversion: 2.1 time: 0.170536 Nov 23 07:51:37.141285 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 550/1047] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:36 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:37.157319 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-893e867a-7f94-4b84-89cf-6ed93c3fb51b req-9413784b-2af3-4608-b4b2-6587b0490f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec45cee-3532-4eee-96c2-3d4cd9b32f5a", "name": "network-vif-deleted", "tag": "d57cfa3c-6e3c-4e17-ba1a-750503169678"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:51:37.159857 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:51:37.159857 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:51:37.168723 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-893e867a-7f94-4b84-89cf-6ed93c3fb51b req-9413784b-2af3-4608-b4b2-6587b0490f69 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:37.169165 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-893e867a-7f94-4b84-89cf-6ed93c3fb51b req-9413784b-2af3-4608-b4b2-6587b0490f69 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:37.181823 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-893e867a-7f94-4b84-89cf-6ed93c3fb51b req-9413784b-2af3-4608-b4b2-6587b0490f69 service nova] Creating event network-vif-deleted:d57cfa3c-6e3c-4e17-ba1a-750503169678 for instance eec45cee-3532-4eee-96c2-3d4cd9b32f5a on hv-cinder-80403 Nov 23 07:51:37.187482 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-893e867a-7f94-4b84-89cf-6ed93c3fb51b req-9413784b-2af3-4608-b4b2-6587b0490f69 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035167 Nov 23 07:51:37.188094 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 498/1048] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:51:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:51:37.368366 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-45acbf7b-511d-477b-bd3d-7ab282df3d82 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:37.369429 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-45acbf7b-511d-477b-bd3d-7ab282df3d82 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:37.376704 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-45acbf7b-511d-477b-bd3d-7ab282df3d82 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:37.377371 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-45acbf7b-511d-477b-bd3d-7ab282df3d82 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:37.378454 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-45acbf7b-511d-477b-bd3d-7ab282df3d82 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:37.379158 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-45acbf7b-511d-477b-bd3d-7ab282df3d82 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:37.419388 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-45acbf7b-511d-477b-bd3d-7ab282df3d82 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:37.419981 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-45acbf7b-511d-477b-bd3d-7ab282df3d82 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:37.420832 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.objects.instance [None req-45acbf7b-511d-477b-bd3d-7ab282df3d82 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lazy-loading 'fault' on Instance uuid eec45cee-3532-4eee-96c2-3d4cd9b32f5a {{(pid=122786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:51:37.470355 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-45acbf7b-511d-477b-bd3d-7ab282df3d82 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:37.479743 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-45acbf7b-511d-477b-bd3d-7ab282df3d82 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 200 len: 1307 microversion: 2.1 time: 0.117074 Nov 23 07:51:37.480358 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 551/1049] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:37 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 1307 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:38.159260 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-12982dc4-f935-4b85-85b7-c92126ff0f80 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:38.159993 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-12982dc4-f935-4b85-85b7-c92126ff0f80 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:38.166820 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-12982dc4-f935-4b85-85b7-c92126ff0f80 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:38.167268 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-12982dc4-f935-4b85-85b7-c92126ff0f80 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:38.168067 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-12982dc4-f935-4b85-85b7-c92126ff0f80 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:38.168504 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-12982dc4-f935-4b85-85b7-c92126ff0f80 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:38.305156 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-12982dc4-f935-4b85-85b7-c92126ff0f80 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:38.313077 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-12982dc4-f935-4b85-85b7-c92126ff0f80 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1575 microversion: 2.1 time: 0.158650 Nov 23 07:51:38.313640 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 499/1050] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:38 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:38.504667 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4d4befec-6fb0-4ac1-96f6-3c26e813ae38 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:38.505275 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4d4befec-6fb0-4ac1-96f6-3c26e813ae38 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: eec45cee-3532-4eee-96c2-3d4cd9b32f5a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:38.511620 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4d4befec-6fb0-4ac1-96f6-3c26e813ae38 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:38.512068 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4d4befec-6fb0-4ac1-96f6-3c26e813ae38 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:38.512845 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4d4befec-6fb0-4ac1-96f6-3c26e813ae38 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:38.513278 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4d4befec-6fb0-4ac1-96f6-3c26e813ae38 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:38.526775 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-4d4befec-6fb0-4ac1-96f6-3c26e813ae38 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] HTTP exception thrown: Instance eec45cee-3532-4eee-96c2-3d4cd9b32f5a could not be found. Nov 23 07:51:38.527357 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4d4befec-6fb0-4ac1-96f6-3c26e813ae38 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Returning 404 to user: Instance eec45cee-3532-4eee-96c2-3d4cd9b32f5a could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:51:38.528159 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4d4befec-6fb0-4ac1-96f6-3c26e813ae38 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a" status: 404 len: 111 microversion: 2.1 time: 0.027186 Nov 23 07:51:38.528679 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 552/1051] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:38 2021] GET /compute/v2.1/servers/eec45cee-3532-4eee-96c2-3d4cd9b32f5a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:51:39.330168 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-26aa40fb-54e6-4c97-9434-f58b6432b80e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:39.330720 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-26aa40fb-54e6-4c97-9434-f58b6432b80e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:39.337031 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-26aa40fb-54e6-4c97-9434-f58b6432b80e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:39.337473 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-26aa40fb-54e6-4c97-9434-f58b6432b80e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:39.338278 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-26aa40fb-54e6-4c97-9434-f58b6432b80e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:39.338705 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-26aa40fb-54e6-4c97-9434-f58b6432b80e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:39.505995 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-26aa40fb-54e6-4c97-9434-f58b6432b80e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:39.518017 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-26aa40fb-54e6-4c97-9434-f58b6432b80e tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1575 microversion: 2.1 time: 0.191291 Nov 23 07:51:39.519062 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 500/1052] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:39 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1575 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:40.543175 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-232e829f-939a-4d9b-9320-ce038a98c8bd tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:40.543777 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-232e829f-939a-4d9b-9320-ce038a98c8bd tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:40.550203 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-232e829f-939a-4d9b-9320-ce038a98c8bd tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:40.550778 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-232e829f-939a-4d9b-9320-ce038a98c8bd tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:40.555620 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-232e829f-939a-4d9b-9320-ce038a98c8bd tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:40.555620 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-232e829f-939a-4d9b-9320-ce038a98c8bd tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:40.699723 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-232e829f-939a-4d9b-9320-ce038a98c8bd tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:40.707996 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-232e829f-939a-4d9b-9320-ce038a98c8bd tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1575 microversion: 2.1 time: 0.168498 Nov 23 07:51:40.708534 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 553/1053] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:40 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:41.724869 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c10c6fad-66c9-4adc-93f0-26bb738f5f02 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:41.725475 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c10c6fad-66c9-4adc-93f0-26bb738f5f02 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:41.731804 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c10c6fad-66c9-4adc-93f0-26bb738f5f02 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:41.732333 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c10c6fad-66c9-4adc-93f0-26bb738f5f02 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:41.733105 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c10c6fad-66c9-4adc-93f0-26bb738f5f02 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:41.733540 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c10c6fad-66c9-4adc-93f0-26bb738f5f02 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:41.761991 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-0b898482-4dd8-41d8-851c-0c0fdc06249d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:41.762512 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-0b898482-4dd8-41d8-851c-0c0fdc06249d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:41.769184 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0b898482-4dd8-41d8-851c-0c0fdc06249d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:41.769632 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0b898482-4dd8-41d8-851c-0c0fdc06249d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:41.770458 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0b898482-4dd8-41d8-851c-0c0fdc06249d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:41.770894 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0b898482-4dd8-41d8-851c-0c0fdc06249d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:41.798851 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-0b898482-4dd8-41d8-851c-0c0fdc06249d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Going to try to terminate instance {{(pid=122786) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:51:41.872776 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c10c6fad-66c9-4adc-93f0-26bb738f5f02 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:41.880882 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c10c6fad-66c9-4adc-93f0-26bb738f5f02 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1575 microversion: 2.1 time: 0.159520 Nov 23 07:51:41.881942 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 501/1054] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:41 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:41.898942 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-0b898482-4dd8-41d8-851c-0c0fdc06249d tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b" status: 204 len: 0 microversion: 2.1 time: 0.140296 Nov 23 07:51:41.899526 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 554/1055] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:51:41 2021] DELETE /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 07:51:41.908580 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-253c90f0-3e13-4da0-b688-02bd3b37dcbe tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:41.909470 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-253c90f0-3e13-4da0-b688-02bd3b37dcbe tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:41.915373 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-253c90f0-3e13-4da0-b688-02bd3b37dcbe tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:41.915816 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-253c90f0-3e13-4da0-b688-02bd3b37dcbe tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:41.916585 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-253c90f0-3e13-4da0-b688-02bd3b37dcbe tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:41.917012 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-253c90f0-3e13-4da0-b688-02bd3b37dcbe tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:42.044606 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-253c90f0-3e13-4da0-b688-02bd3b37dcbe tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:42.051955 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-253c90f0-3e13-4da0-b688-02bd3b37dcbe tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b" status: 200 len: 1515 microversion: 2.1 time: 0.148051 Nov 23 07:51:42.052523 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 502/1056] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:41 2021] GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:42.900291 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-3a0324ea-7e1e-460c-9e60-e7122ef88f31 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:42.903883 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-3a0324ea-7e1e-460c-9e60-e7122ef88f31 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:42.907503 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3a0324ea-7e1e-460c-9e60-e7122ef88f31 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:42.907923 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3a0324ea-7e1e-460c-9e60-e7122ef88f31 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:42.908703 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3a0324ea-7e1e-460c-9e60-e7122ef88f31 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:42.909393 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3a0324ea-7e1e-460c-9e60-e7122ef88f31 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:43.048883 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-3a0324ea-7e1e-460c-9e60-e7122ef88f31 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:43.056383 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-3a0324ea-7e1e-460c-9e60-e7122ef88f31 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1575 microversion: 2.1 time: 0.160064 Nov 23 07:51:43.056951 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 555/1057] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:42 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:43.069510 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-8eab1af8-0c2c-4038-a17d-a46ea3872d55 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:43.070151 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-8eab1af8-0c2c-4038-a17d-a46ea3872d55 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:43.077111 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8eab1af8-0c2c-4038-a17d-a46ea3872d55 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:43.078132 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8eab1af8-0c2c-4038-a17d-a46ea3872d55 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:43.078374 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8eab1af8-0c2c-4038-a17d-a46ea3872d55 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:43.078805 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-8eab1af8-0c2c-4038-a17d-a46ea3872d55 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:43.474593 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-8eab1af8-0c2c-4038-a17d-a46ea3872d55 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:43.482687 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-8eab1af8-0c2c-4038-a17d-a46ea3872d55 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b" status: 200 len: 1515 microversion: 2.1 time: 0.416155 Nov 23 07:51:43.484159 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 503/1058] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:43 2021] GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b => generated 1515 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:44.077986 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4f45af57-e186-4c54-a52c-b78a98960569 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:44.078938 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4f45af57-e186-4c54-a52c-b78a98960569 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:44.088273 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4f45af57-e186-4c54-a52c-b78a98960569 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:44.089032 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4f45af57-e186-4c54-a52c-b78a98960569 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:44.090960 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4f45af57-e186-4c54-a52c-b78a98960569 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:44.092328 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4f45af57-e186-4c54-a52c-b78a98960569 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:44.197904 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-4939f7f6-29fe-408c-ab31-b3595476c47b req-2a9bafc8-cad5-480b-b7ba-78a3754fcfe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebe5ca4-b941-4d96-9c13-8cbe51b0236b", "name": "network-vif-deleted", "tag": "99777abd-c894-4087-bb08-0fe3fe38c8c7"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:51:44.199595 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:51:44.199595 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:51:44.216507 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-4939f7f6-29fe-408c-ab31-b3595476c47b req-2a9bafc8-cad5-480b-b7ba-78a3754fcfe6 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:44.217373 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-4939f7f6-29fe-408c-ab31-b3595476c47b req-2a9bafc8-cad5-480b-b7ba-78a3754fcfe6 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:44.247732 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-4939f7f6-29fe-408c-ab31-b3595476c47b req-2a9bafc8-cad5-480b-b7ba-78a3754fcfe6 service nova] Creating event network-vif-deleted:99777abd-c894-4087-bb08-0fe3fe38c8c7 for instance 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b on hv-cinder-80403 Nov 23 07:51:44.256181 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-4939f7f6-29fe-408c-ab31-b3595476c47b req-2a9bafc8-cad5-480b-b7ba-78a3754fcfe6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061565 Nov 23 07:51:44.257544 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 504/1059] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:51:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:51:44.329095 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-4f45af57-e186-4c54-a52c-b78a98960569 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:44.339073 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4f45af57-e186-4c54-a52c-b78a98960569 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1575 microversion: 2.1 time: 0.269129 Nov 23 07:51:44.340818 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 556/1060] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:44 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1575 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:44.500896 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3196311a-5a5a-4ed7-bd24-5ac25ff1fae4 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:44.501605 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3196311a-5a5a-4ed7-bd24-5ac25ff1fae4 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:44.510228 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3196311a-5a5a-4ed7-bd24-5ac25ff1fae4 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:44.510837 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3196311a-5a5a-4ed7-bd24-5ac25ff1fae4 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:44.513088 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3196311a-5a5a-4ed7-bd24-5ac25ff1fae4 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:44.513575 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3196311a-5a5a-4ed7-bd24-5ac25ff1fae4 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:44.559569 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3196311a-5a5a-4ed7-bd24-5ac25ff1fae4 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:44.559874 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3196311a-5a5a-4ed7-bd24-5ac25ff1fae4 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:44.560305 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.objects.instance [None req-3196311a-5a5a-4ed7-bd24-5ac25ff1fae4 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lazy-loading 'fault' on Instance uuid 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b {{(pid=122785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:51:44.606704 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-3196311a-5a5a-4ed7-bd24-5ac25ff1fae4 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:44.615877 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3196311a-5a5a-4ed7-bd24-5ac25ff1fae4 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b" status: 200 len: 1308 microversion: 2.1 time: 0.119048 Nov 23 07:51:44.617123 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 505/1061] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:44 2021] GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:45.045924 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-2199e0a0-1094-4e72-9055-ecddf6b4c433 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:45.046316 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-2199e0a0-1094-4e72-9055-ecddf6b4c433 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:45.053748 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2199e0a0-1094-4e72-9055-ecddf6b4c433 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:45.055092 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2199e0a0-1094-4e72-9055-ecddf6b4c433 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:45.056937 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2199e0a0-1094-4e72-9055-ecddf6b4c433 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:45.057620 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-2199e0a0-1094-4e72-9055-ecddf6b4c433 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:45.099203 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-2199e0a0-1094-4e72-9055-ecddf6b4c433 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Going to try to terminate instance {{(pid=122786) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:51:45.196694 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-2199e0a0-1094-4e72-9055-ecddf6b4c433 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 204 len: 0 microversion: 2.1 time: 0.155262 Nov 23 07:51:45.202097 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 557/1062] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:51:45 2021] DELETE /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 07:51:45.211491 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5d8797dd-48ec-4a95-b0d9-c5cdc4dc47a1 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:45.212308 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5d8797dd-48ec-4a95-b0d9-c5cdc4dc47a1 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:45.219937 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5d8797dd-48ec-4a95-b0d9-c5cdc4dc47a1 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:45.220570 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5d8797dd-48ec-4a95-b0d9-c5cdc4dc47a1 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:45.221394 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5d8797dd-48ec-4a95-b0d9-c5cdc4dc47a1 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:45.221860 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5d8797dd-48ec-4a95-b0d9-c5cdc4dc47a1 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:45.381192 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a74062fd-056b-424e-9ff0-72daf9f32a03 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:45.382698 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a74062fd-056b-424e-9ff0-72daf9f32a03 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:45.390847 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5d8797dd-48ec-4a95-b0d9-c5cdc4dc47a1 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:45.396931 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a74062fd-056b-424e-9ff0-72daf9f32a03 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:45.397671 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a74062fd-056b-424e-9ff0-72daf9f32a03 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:45.399140 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a74062fd-056b-424e-9ff0-72daf9f32a03 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:45.400079 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a74062fd-056b-424e-9ff0-72daf9f32a03 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:45.404700 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5d8797dd-48ec-4a95-b0d9-c5cdc4dc47a1 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1577 microversion: 2.1 time: 0.200451 Nov 23 07:51:45.405827 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 506/1063] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:45 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1577 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:45.553094 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a74062fd-056b-424e-9ff0-72daf9f32a03 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:45.562586 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a74062fd-056b-424e-9ff0-72daf9f32a03 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1575 microversion: 2.1 time: 0.190076 Nov 23 07:51:45.563124 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 558/1064] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:45 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:45.634692 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-63ab3822-3a7c-4e27-a43a-8f9b411ec2d5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:45.635313 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-63ab3822-3a7c-4e27-a43a-8f9b411ec2d5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:45.641939 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-63ab3822-3a7c-4e27-a43a-8f9b411ec2d5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:45.642389 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-63ab3822-3a7c-4e27-a43a-8f9b411ec2d5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:45.643188 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-63ab3822-3a7c-4e27-a43a-8f9b411ec2d5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:45.643622 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-63ab3822-3a7c-4e27-a43a-8f9b411ec2d5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:45.661100 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-63ab3822-3a7c-4e27-a43a-8f9b411ec2d5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] HTTP exception thrown: Instance 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b could not be found. Nov 23 07:51:45.662862 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-63ab3822-3a7c-4e27-a43a-8f9b411ec2d5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Returning 404 to user: Instance 3ebe5ca4-b941-4d96-9c13-8cbe51b0236b could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:51:45.662862 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-63ab3822-3a7c-4e27-a43a-8f9b411ec2d5 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b" status: 404 len: 111 microversion: 2.1 time: 0.031996 Nov 23 07:51:45.663334 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 507/1065] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:45 2021] GET /compute/v2.1/servers/3ebe5ca4-b941-4d96-9c13-8cbe51b0236b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:51:45.676089 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ea76e8ef-832b-40ac-8655-aeb9a3915720 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:45.676589 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ea76e8ef-832b-40ac-8655-aeb9a3915720 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3fce3d66-d323-4507-8ba9-d8cc96d4e92f] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:45.683723 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea76e8ef-832b-40ac-8655-aeb9a3915720 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:45.684217 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea76e8ef-832b-40ac-8655-aeb9a3915720 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:45.685878 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea76e8ef-832b-40ac-8655-aeb9a3915720 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:45.686450 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ea76e8ef-832b-40ac-8655-aeb9a3915720 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:45.713261 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ea76e8ef-832b-40ac-8655-aeb9a3915720 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3fce3d66-d323-4507-8ba9-d8cc96d4e92f] Going to try to terminate instance {{(pid=122786) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:51:45.801952 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ea76e8ef-832b-40ac-8655-aeb9a3915720 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f" status: 204 len: 0 microversion: 2.1 time: 0.130310 Nov 23 07:51:45.802649 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 559/1066] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:51:45 2021] DELETE /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 07:51:45.811897 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ad3cc0e4-c7d7-4100-a730-85538d932581 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:45.812586 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-ad3cc0e4-c7d7-4100-a730-85538d932581 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3fce3d66-d323-4507-8ba9-d8cc96d4e92f] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:45.819156 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ad3cc0e4-c7d7-4100-a730-85538d932581 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:45.819528 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ad3cc0e4-c7d7-4100-a730-85538d932581 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:45.820307 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ad3cc0e4-c7d7-4100-a730-85538d932581 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:45.820740 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-ad3cc0e4-c7d7-4100-a730-85538d932581 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:45.960334 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-ad3cc0e4-c7d7-4100-a730-85538d932581 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:45.968460 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ad3cc0e4-c7d7-4100-a730-85538d932581 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f" status: 200 len: 1513 microversion: 2.1 time: 0.161098 Nov 23 07:51:45.969040 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 508/1067] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:45 2021] GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:46.432931 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-0b6d0197-0b69-4488-99bb-dea4e462cc37 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:46.433617 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-0b6d0197-0b69-4488-99bb-dea4e462cc37 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:46.440076 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0b6d0197-0b69-4488-99bb-dea4e462cc37 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:46.440518 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0b6d0197-0b69-4488-99bb-dea4e462cc37 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:46.441575 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0b6d0197-0b69-4488-99bb-dea4e462cc37 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:46.442109 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0b6d0197-0b69-4488-99bb-dea4e462cc37 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:46.580831 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c7fb53d1-8eae-45fa-921d-4e042e8dbe11 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:46.581467 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c7fb53d1-8eae-45fa-921d-4e042e8dbe11 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:46.587993 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c7fb53d1-8eae-45fa-921d-4e042e8dbe11 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:46.588444 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c7fb53d1-8eae-45fa-921d-4e042e8dbe11 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:46.589223 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c7fb53d1-8eae-45fa-921d-4e042e8dbe11 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:46.589658 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c7fb53d1-8eae-45fa-921d-4e042e8dbe11 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:46.601556 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-0b6d0197-0b69-4488-99bb-dea4e462cc37 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:46.611091 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-0b6d0197-0b69-4488-99bb-dea4e462cc37 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1577 microversion: 2.1 time: 0.181923 Nov 23 07:51:46.612142 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 560/1068] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:46 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:46.734569 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-c7fb53d1-8eae-45fa-921d-4e042e8dbe11 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:46.744229 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c7fb53d1-8eae-45fa-921d-4e042e8dbe11 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1575 microversion: 2.1 time: 0.167116 Nov 23 07:51:46.744846 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 509/1069] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:46 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:51:46.770889 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-8bd772e4-3743-4157-9d03-11e44aaf1b2e req-a1571646-0b25-45d6-9b9e-09c035e2c773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be38773-5840-4e15-b2f5-ce77caceb858", "name": "network-vif-plugged", "status": "completed", "tag": "a7bd6f41-4ac3-41e3-8d6f-dd2993595bc7"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:51:46.772455 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:51:46.772455 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:51:46.779813 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-8bd772e4-3743-4157-9d03-11e44aaf1b2e req-a1571646-0b25-45d6-9b9e-09c035e2c773 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:46.780449 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-8bd772e4-3743-4157-9d03-11e44aaf1b2e req-a1571646-0b25-45d6-9b9e-09c035e2c773 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:46.792139 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-8bd772e4-3743-4157-9d03-11e44aaf1b2e req-a1571646-0b25-45d6-9b9e-09c035e2c773 service nova] Creating event network-vif-plugged:a7bd6f41-4ac3-41e3-8d6f-dd2993595bc7 for instance 4be38773-5840-4e15-b2f5-ce77caceb858 on hv-cinder-80403 Nov 23 07:51:46.797075 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-8bd772e4-3743-4157-9d03-11e44aaf1b2e req-a1571646-0b25-45d6-9b9e-09c035e2c773 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029828 Nov 23 07:51:46.797917 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 561/1070] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:51:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:51:46.987058 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3fb3d67d-0348-47f8-9374-c03ae0351458 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:46.988228 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3fb3d67d-0348-47f8-9374-c03ae0351458 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3fce3d66-d323-4507-8ba9-d8cc96d4e92f] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:46.997933 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3fb3d67d-0348-47f8-9374-c03ae0351458 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:46.999257 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3fb3d67d-0348-47f8-9374-c03ae0351458 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:47.000207 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3fb3d67d-0348-47f8-9374-c03ae0351458 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:47.000711 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3fb3d67d-0348-47f8-9374-c03ae0351458 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:47.310091 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-3fb3d67d-0348-47f8-9374-c03ae0351458 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:47.318568 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3fb3d67d-0348-47f8-9374-c03ae0351458 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f" status: 200 len: 1513 microversion: 2.1 time: 0.335363 Nov 23 07:51:47.319147 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 510/1071] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:46 2021] GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f => generated 1513 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:47.628624 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-7b84cd55-7c20-4c29-8e76-ebda706b7d1e tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:47.629336 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-7b84cd55-7c20-4c29-8e76-ebda706b7d1e tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:47.635572 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7b84cd55-7c20-4c29-8e76-ebda706b7d1e tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:47.636017 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7b84cd55-7c20-4c29-8e76-ebda706b7d1e tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:47.636804 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7b84cd55-7c20-4c29-8e76-ebda706b7d1e tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:47.637244 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-7b84cd55-7c20-4c29-8e76-ebda706b7d1e tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:47.771375 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-58a41501-7b02-4f9d-b85d-f1f7a60b907a tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:47.773614 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-58a41501-7b02-4f9d-b85d-f1f7a60b907a tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:47.783231 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-7b84cd55-7c20-4c29-8e76-ebda706b7d1e tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:47.785694 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-58a41501-7b02-4f9d-b85d-f1f7a60b907a tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:47.787152 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-58a41501-7b02-4f9d-b85d-f1f7a60b907a tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:47.788073 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-58a41501-7b02-4f9d-b85d-f1f7a60b907a tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:47.788723 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-58a41501-7b02-4f9d-b85d-f1f7a60b907a tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:47.791748 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-7b84cd55-7c20-4c29-8e76-ebda706b7d1e tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1577 microversion: 2.1 time: 0.167911 Nov 23 07:51:47.792529 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 562/1072] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:47 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:48.158278 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-58a41501-7b02-4f9d-b85d-f1f7a60b907a tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:48.167041 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-58a41501-7b02-4f9d-b85d-f1f7a60b907a tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1575 microversion: 2.1 time: 0.404745 Nov 23 07:51:48.167810 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 511/1073] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:47 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1575 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:48.341518 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-0bea8ffa-5a2d-4d2f-a51d-2c63f4b8cec0 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:48.342917 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-0bea8ffa-5a2d-4d2f-a51d-2c63f4b8cec0 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3fce3d66-d323-4507-8ba9-d8cc96d4e92f] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:48.346412 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-1d8aaa6d-53f0-4dd9-9699-46ad1bf26534 req-6eefb80f-a4a5-4949-a39f-6dd698a1bb18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e6c04f8-01f0-44e2-9232-f865f1af5591", "name": "network-vif-deleted", "tag": "89fe006c-5309-4d1a-9597-f6755351dfd8"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:51:48.348778 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:51:48.348778 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:51:48.358185 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0bea8ffa-5a2d-4d2f-a51d-2c63f4b8cec0 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:48.358965 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0bea8ffa-5a2d-4d2f-a51d-2c63f4b8cec0 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:48.360193 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0bea8ffa-5a2d-4d2f-a51d-2c63f4b8cec0 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:48.361927 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0bea8ffa-5a2d-4d2f-a51d-2c63f4b8cec0 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:48.363528 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-1d8aaa6d-53f0-4dd9-9699-46ad1bf26534 req-6eefb80f-a4a5-4949-a39f-6dd698a1bb18 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:48.364617 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-1d8aaa6d-53f0-4dd9-9699-46ad1bf26534 req-6eefb80f-a4a5-4949-a39f-6dd698a1bb18 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:48.386574 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-1d8aaa6d-53f0-4dd9-9699-46ad1bf26534 req-6eefb80f-a4a5-4949-a39f-6dd698a1bb18 service nova] Creating event network-vif-deleted:89fe006c-5309-4d1a-9597-f6755351dfd8 for instance 9e6c04f8-01f0-44e2-9232-f865f1af5591 on hv-cinder-80403 Nov 23 07:51:48.394368 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-1d8aaa6d-53f0-4dd9-9699-46ad1bf26534 req-6eefb80f-a4a5-4949-a39f-6dd698a1bb18 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051832 Nov 23 07:51:48.397925 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 512/1074] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:51:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:51:48.495655 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-0bea8ffa-5a2d-4d2f-a51d-2c63f4b8cec0 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:48.505763 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-0bea8ffa-5a2d-4d2f-a51d-2c63f4b8cec0 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f" status: 200 len: 1471 microversion: 2.1 time: 0.170914 Nov 23 07:51:48.507053 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 563/1075] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:48 2021] GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:48.816203 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d46e1bb3-e932-40dd-a7e6-6339e7b22b9a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:48.817184 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d46e1bb3-e932-40dd-a7e6-6339e7b22b9a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:48.825500 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d46e1bb3-e932-40dd-a7e6-6339e7b22b9a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:48.826152 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d46e1bb3-e932-40dd-a7e6-6339e7b22b9a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:48.827071 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d46e1bb3-e932-40dd-a7e6-6339e7b22b9a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:48.827616 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d46e1bb3-e932-40dd-a7e6-6339e7b22b9a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:48.862114 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d46e1bb3-e932-40dd-a7e6-6339e7b22b9a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:48.862567 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d46e1bb3-e932-40dd-a7e6-6339e7b22b9a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:48.863025 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.objects.instance [None req-d46e1bb3-e932-40dd-a7e6-6339e7b22b9a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lazy-loading 'fault' on Instance uuid 9e6c04f8-01f0-44e2-9232-f865f1af5591 {{(pid=122785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 07:51:48.927005 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d46e1bb3-e932-40dd-a7e6-6339e7b22b9a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:48.942351 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d46e1bb3-e932-40dd-a7e6-6339e7b22b9a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 200 len: 1230 microversion: 2.1 time: 0.135209 Nov 23 07:51:48.943557 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 513/1076] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:48 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 1230 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:49.187613 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-19d07178-ea5b-4254-a827-2dfd15af95f4 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:49.188310 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-19d07178-ea5b-4254-a827-2dfd15af95f4 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:49.195018 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-19d07178-ea5b-4254-a827-2dfd15af95f4 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:49.195460 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-19d07178-ea5b-4254-a827-2dfd15af95f4 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:49.196240 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-19d07178-ea5b-4254-a827-2dfd15af95f4 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:49.196665 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-19d07178-ea5b-4254-a827-2dfd15af95f4 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:49.405870 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-19d07178-ea5b-4254-a827-2dfd15af95f4 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:49.419112 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-19d07178-ea5b-4254-a827-2dfd15af95f4 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1562 microversion: 2.1 time: 0.235206 Nov 23 07:51:49.420236 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 564/1077] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:49 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1562 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:49.524454 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d3fc0553-4b9b-418b-bc73-c7252a28e33e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:49.525145 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d3fc0553-4b9b-418b-bc73-c7252a28e33e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: 3fce3d66-d323-4507-8ba9-d8cc96d4e92f] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:49.532160 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d3fc0553-4b9b-418b-bc73-c7252a28e33e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:49.532601 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d3fc0553-4b9b-418b-bc73-c7252a28e33e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:49.533386 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d3fc0553-4b9b-418b-bc73-c7252a28e33e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:49.534099 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d3fc0553-4b9b-418b-bc73-c7252a28e33e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:49.548340 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-d3fc0553-4b9b-418b-bc73-c7252a28e33e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] HTTP exception thrown: Instance 3fce3d66-d323-4507-8ba9-d8cc96d4e92f could not be found. Nov 23 07:51:49.548947 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d3fc0553-4b9b-418b-bc73-c7252a28e33e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Returning 404 to user: Instance 3fce3d66-d323-4507-8ba9-d8cc96d4e92f could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:51:49.549812 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d3fc0553-4b9b-418b-bc73-c7252a28e33e tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f" status: 404 len: 111 microversion: 2.1 time: 0.029323 Nov 23 07:51:49.550348 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 514/1078] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:49 2021] GET /compute/v2.1/servers/3fce3d66-d323-4507-8ba9-d8cc96d4e92f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:51:49.962616 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c90c20cf-b0a3-4657-989d-0663fcbac203 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:49.963231 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c90c20cf-b0a3-4657-989d-0663fcbac203 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:49.969444 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c90c20cf-b0a3-4657-989d-0663fcbac203 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:49.969920 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c90c20cf-b0a3-4657-989d-0663fcbac203 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:49.970739 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c90c20cf-b0a3-4657-989d-0663fcbac203 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:49.971178 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c90c20cf-b0a3-4657-989d-0663fcbac203 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:49.986258 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-c90c20cf-b0a3-4657-989d-0663fcbac203 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] HTTP exception thrown: Instance 9e6c04f8-01f0-44e2-9232-f865f1af5591 could not be found. Nov 23 07:51:49.986850 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c90c20cf-b0a3-4657-989d-0663fcbac203 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Returning 404 to user: Instance 9e6c04f8-01f0-44e2-9232-f865f1af5591 could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:51:49.987683 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c90c20cf-b0a3-4657-989d-0663fcbac203 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 404 len: 111 microversion: 2.1 time: 0.029246 Nov 23 07:51:49.988244 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 565/1079] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:49 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:51:50.096360 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c4017f97-2f32-41a0-b506-3c4ceec506db tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-711558327", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-592728128", "security_groups": [{"name": "tempest-secgroup-smoke-1517785560"}], "block_device_mapping_v2": [{"uuid": "6ed2a68d-991b-4e3e-9485-1ad2db494a54", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c4affbc5-6672-4357-8ba0-5a39b14c7726"}]}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:51:50.232420 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.network.neutron [None req-c4017f97-2f32-41a0-b506-3c4ceec506db tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] validate_networks() for [('c4affbc5-6672-4357-8ba0-5a39b14c7726', None, None, None, None, None)] {{(pid=122785) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:51:50.420965 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-5b1326ca-b2a0-40ef-b293-bb9548eee0df req-cc4e7035-e3cb-4ca5-945b-ec2ae72fc03d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fce3d66-d323-4507-8ba9-d8cc96d4e92f", "name": "network-vif-deleted", "tag": "b0419753-47d6-423f-8dd1-7b53b313da63"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:51:50.422737 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:51:50.422737 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:51:50.430806 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-5b1326ca-b2a0-40ef-b293-bb9548eee0df req-cc4e7035-e3cb-4ca5-945b-ec2ae72fc03d service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:50.431304 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-5b1326ca-b2a0-40ef-b293-bb9548eee0df req-cc4e7035-e3cb-4ca5-945b-ec2ae72fc03d service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:50.444748 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-5b1326ca-b2a0-40ef-b293-bb9548eee0df req-cc4e7035-e3cb-4ca5-945b-ec2ae72fc03d service nova] Creating event network-vif-deleted:b0419753-47d6-423f-8dd1-7b53b313da63 for instance 3fce3d66-d323-4507-8ba9-d8cc96d4e92f on hv-cinder-80403 Nov 23 07:51:50.451715 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-5b1326ca-b2a0-40ef-b293-bb9548eee0df req-cc4e7035-e3cb-4ca5-945b-ec2ae72fc03d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035883 Nov 23 07:51:50.452828 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 566/1080] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:51:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:51:50.694002 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-c4017f97-2f32-41a0-b506-3c4ceec506db tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Flavor limits 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:51:50.694951 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-c4017f97-2f32-41a0-b506-3c4ceec506db tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Image limits 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:51:50.695795 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-c4017f97-2f32-41a0-b506-3c4ceec506db tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Flavor pref 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:51:50.696544 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-c4017f97-2f32-41a0-b506-3c4ceec506db tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Image pref 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:51:50.697341 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-c4017f97-2f32-41a0-b506-3c4ceec506db tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:51:50.697961 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-09eb0621-5329-46ca-9ce1-12802da36c77 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:50.698543 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-09eb0621-5329-46ca-9ce1-12802da36c77 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:50.705501 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-09eb0621-5329-46ca-9ce1-12802da36c77 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:50.705966 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-09eb0621-5329-46ca-9ce1-12802da36c77 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:50.706890 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-09eb0621-5329-46ca-9ce1-12802da36c77 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:50.707189 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-09eb0621-5329-46ca-9ce1-12802da36c77 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:50.712686 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c4017f97-2f32-41a0-b506-3c4ceec506db tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:50.713442 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c4017f97-2f32-41a0-b506-3c4ceec506db tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:50.714911 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c4017f97-2f32-41a0-b506-3c4ceec506db tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:50.715659 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c4017f97-2f32-41a0-b506-3c4ceec506db tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:50.733958 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-09eb0621-5329-46ca-9ce1-12802da36c77 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] Going to try to terminate instance {{(pid=122786) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:51:50.745283 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-c4017f97-2f32-41a0-b506-3c4ceec506db tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Getting quotas for project 923ced17fbea41d2bb472b52dd316477. Resources: {'instances', 'cores', 'ram'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:51:50.752086 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-c4017f97-2f32-41a0-b506-3c4ceec506db tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Getting quotas for user cbb14b561f25411684be4c930e712800 and project 923ced17fbea41d2bb472b52dd316477. Resources: {'instances', 'cores', 'ram'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:51:50.820091 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c4017f97-2f32-41a0-b506-3c4ceec506db tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Going to run 1 instances... {{(pid=122785) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:51:50.822400 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c4017f97-2f32-41a0-b506-3c4ceec506db tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6ed2a68d-991b-4e3e-9485-1ad2db494a54',volume_size=None,volume_type=None)] {{(pid=122785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:51:50.843519 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-09eb0621-5329-46ca-9ce1-12802da36c77 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e" status: 204 len: 0 microversion: 2.1 time: 0.149043 Nov 23 07:51:50.844464 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 567/1081] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:51:50 2021] DELETE /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 07:51:50.858667 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4222a9ea-6a0b-4037-9c1a-aa2aa276a667 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:50.858667 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4222a9ea-6a0b-4037-9c1a-aa2aa276a667 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:50.868046 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4222a9ea-6a0b-4037-9c1a-aa2aa276a667 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:50.868881 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4222a9ea-6a0b-4037-9c1a-aa2aa276a667 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:50.870333 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4222a9ea-6a0b-4037-9c1a-aa2aa276a667 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:50.871109 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4222a9ea-6a0b-4037-9c1a-aa2aa276a667 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:50.979172 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c4017f97-2f32-41a0-b506-3c4ceec506db tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.886485 Nov 23 07:51:50.979836 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 515/1082] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Nov 23 07:51:50 2021] POST /compute/v2.1/servers => generated 406 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 07:51:50.990884 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-916bf391-138c-4e3c-99a5-8419ff1927a0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:50.991495 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-916bf391-138c-4e3c-99a5-8419ff1927a0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:51.061429 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-4222a9ea-6a0b-4037-9c1a-aa2aa276a667 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:51.061683 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-916bf391-138c-4e3c-99a5-8419ff1927a0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:51.071279 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-916bf391-138c-4e3c-99a5-8419ff1927a0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 200 len: 1093 microversion: 2.1 time: 0.084310 Nov 23 07:51:51.081032 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4222a9ea-6a0b-4037-9c1a-aa2aa276a667 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e" status: 200 len: 1513 microversion: 2.1 time: 0.226343 Nov 23 07:51:51.081308 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 516/1083] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:50 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 1093 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:51.082333 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 568/1084] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:50 2021] GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:52.089914 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-0221c6a7-3291-4427-9d6c-0766c826d21d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:52.090944 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-0221c6a7-3291-4427-9d6c-0766c826d21d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:52.098089 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0221c6a7-3291-4427-9d6c-0766c826d21d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:52.098551 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0221c6a7-3291-4427-9d6c-0766c826d21d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:52.099316 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0221c6a7-3291-4427-9d6c-0766c826d21d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:52.100084 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-0221c6a7-3291-4427-9d6c-0766c826d21d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:52.107080 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-594d9284-9382-4ce6-bb8a-352bd7043dbd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:52.108613 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-594d9284-9382-4ce6-bb8a-352bd7043dbd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:52.128072 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-594d9284-9382-4ce6-bb8a-352bd7043dbd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:52.130117 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-594d9284-9382-4ce6-bb8a-352bd7043dbd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:52.131118 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-594d9284-9382-4ce6-bb8a-352bd7043dbd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:52.131789 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-594d9284-9382-4ce6-bb8a-352bd7043dbd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:52.225959 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-0221c6a7-3291-4427-9d6c-0766c826d21d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:52.246197 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-0221c6a7-3291-4427-9d6c-0766c826d21d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 200 len: 1209 microversion: 2.1 time: 0.160246 Nov 23 07:51:52.248451 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 517/1085] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:52 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 1209 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:51:52.297328 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-594d9284-9382-4ce6-bb8a-352bd7043dbd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:52.312270 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-594d9284-9382-4ce6-bb8a-352bd7043dbd tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e" status: 200 len: 1513 microversion: 2.1 time: 0.208128 Nov 23 07:51:52.313439 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 569/1086] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:52 2021] GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e => generated 1513 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:53.269346 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-4983e12b-b296-4511-9fdc-34849aa7c399 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:53.270982 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-4983e12b-b296-4511-9fdc-34849aa7c399 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:53.280251 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4983e12b-b296-4511-9fdc-34849aa7c399 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:53.280998 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4983e12b-b296-4511-9fdc-34849aa7c399 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:53.281873 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4983e12b-b296-4511-9fdc-34849aa7c399 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:53.282486 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-4983e12b-b296-4511-9fdc-34849aa7c399 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:53.348478 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1fd4d7f9-cc60-4496-ab6c-70447bda7013 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:53.349547 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-1fd4d7f9-cc60-4496-ab6c-70447bda7013 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:53.374064 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1fd4d7f9-cc60-4496-ab6c-70447bda7013 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:53.374843 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1fd4d7f9-cc60-4496-ab6c-70447bda7013 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:53.375939 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1fd4d7f9-cc60-4496-ab6c-70447bda7013 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:53.376721 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-1fd4d7f9-cc60-4496-ab6c-70447bda7013 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:53.468267 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-1fd4d7f9-cc60-4496-ab6c-70447bda7013 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a32fdae11324218aed54988a2b9ec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c77eb8adee494f8cddcb74d01e7183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:53.485666 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1fd4d7f9-cc60-4496-ab6c-70447bda7013 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e" status: 200 len: 1471 microversion: 2.1 time: 0.148247 Nov 23 07:51:53.487021 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 570/1087] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:53 2021] GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:53.509370 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-25a6e696-3eb5-4726-8e2b-9b2cd57cc3d2 req-3fcf3ceb-5604-47a5-a662-51d33050984d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd14c70e-fcc6-45f7-950f-fe16de2e3c4e", "name": "network-vif-deleted", "tag": "e6b62974-a146-42bc-98de-1fcf45a35bc8"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:51:53.513183 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:51:53.513183 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:51:53.531258 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-25a6e696-3eb5-4726-8e2b-9b2cd57cc3d2 req-3fcf3ceb-5604-47a5-a662-51d33050984d service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:53.532702 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-25a6e696-3eb5-4726-8e2b-9b2cd57cc3d2 req-3fcf3ceb-5604-47a5-a662-51d33050984d service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:53.561579 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-25a6e696-3eb5-4726-8e2b-9b2cd57cc3d2 req-3fcf3ceb-5604-47a5-a662-51d33050984d service nova] Creating event network-vif-deleted:e6b62974-a146-42bc-98de-1fcf45a35bc8 for instance dd14c70e-fcc6-45f7-950f-fe16de2e3c4e on hv-cinder-80403 Nov 23 07:51:53.570763 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-25a6e696-3eb5-4726-8e2b-9b2cd57cc3d2 req-3fcf3ceb-5604-47a5-a662-51d33050984d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068386 Nov 23 07:51:53.571980 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 571/1088] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:51:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:51:53.928185 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-4983e12b-b296-4511-9fdc-34849aa7c399 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:53.936618 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-4983e12b-b296-4511-9fdc-34849aa7c399 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 200 len: 1265 microversion: 2.1 time: 0.673681 Nov 23 07:51:53.937400 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 518/1089] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:53 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 1265 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:54.507385 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8b9c80f2-cfa0-4c30-b46d-3328a10c0c43 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:54.508319 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-8b9c80f2-cfa0-4c30-b46d-3328a10c0c43 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] [instance: dd14c70e-fcc6-45f7-950f-fe16de2e3c4e] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:54.516666 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8b9c80f2-cfa0-4c30-b46d-3328a10c0c43 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:54.517412 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8b9c80f2-cfa0-4c30-b46d-3328a10c0c43 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:54.518708 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8b9c80f2-cfa0-4c30-b46d-3328a10c0c43 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:54.519446 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-8b9c80f2-cfa0-4c30-b46d-3328a10c0c43 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:54.534466 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-8b9c80f2-cfa0-4c30-b46d-3328a10c0c43 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] HTTP exception thrown: Instance dd14c70e-fcc6-45f7-950f-fe16de2e3c4e could not be found. Nov 23 07:51:54.535173 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8b9c80f2-cfa0-4c30-b46d-3328a10c0c43 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] Returning 404 to user: Instance dd14c70e-fcc6-45f7-950f-fe16de2e3c4e could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:51:54.536102 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-8b9c80f2-cfa0-4c30-b46d-3328a10c0c43 tempest-AttachVolumeNegativeTest-1145158366 tempest-AttachVolumeNegativeTest-1145158366-project] 10.222.0.48 "GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e" status: 404 len: 111 microversion: 2.1 time: 0.035075 Nov 23 07:51:54.536751 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 572/1090] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:54 2021] GET /compute/v2.1/servers/dd14c70e-fcc6-45f7-950f-fe16de2e3c4e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:51:54.961326 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-88be7b81-4631-43b8-8f4e-adeceba02176 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:54.961962 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-88be7b81-4631-43b8-8f4e-adeceba02176 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:54.969067 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-88be7b81-4631-43b8-8f4e-adeceba02176 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:54.969451 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-88be7b81-4631-43b8-8f4e-adeceba02176 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:54.970285 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-88be7b81-4631-43b8-8f4e-adeceba02176 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:54.970726 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-88be7b81-4631-43b8-8f4e-adeceba02176 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:55.238244 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-88be7b81-4631-43b8-8f4e-adeceba02176 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:55.250747 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-88be7b81-4631-43b8-8f4e-adeceba02176 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 200 len: 1265 microversion: 2.1 time: 0.293057 Nov 23 07:51:55.252206 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 519/1091] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:54 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:55.591788 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-83afa0db-13da-4515-9c13-77c79d3d452e req-5f283b1e-baee-491e-9b29-f1ff3c2fdc73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18f5dd9-65e2-499f-94d9-4d2b8a657e1a", "tag": "9e3b2c21-6496-4e46-b7a3-80855a393bc3"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:51:55.593575 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:51:55.593575 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:51:55.601024 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-83afa0db-13da-4515-9c13-77c79d3d452e req-5f283b1e-baee-491e-9b29-f1ff3c2fdc73 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:55.601456 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-83afa0db-13da-4515-9c13-77c79d3d452e req-5f283b1e-baee-491e-9b29-f1ff3c2fdc73 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:55.616320 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-83afa0db-13da-4515-9c13-77c79d3d452e req-5f283b1e-baee-491e-9b29-f1ff3c2fdc73 service nova] Creating event network-changed:9e3b2c21-6496-4e46-b7a3-80855a393bc3 for instance e18f5dd9-65e2-499f-94d9-4d2b8a657e1a on hv-cinder-80403 Nov 23 07:51:55.624006 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-83afa0db-13da-4515-9c13-77c79d3d452e req-5f283b1e-baee-491e-9b29-f1ff3c2fdc73 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035575 Nov 23 07:51:55.625274 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 573/1092] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:51:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:51:56.269583 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-b5799f94-298e-4ae6-8f4c-7c8a993e3811 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:56.270378 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-b5799f94-298e-4ae6-8f4c-7c8a993e3811 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:56.277987 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b5799f94-298e-4ae6-8f4c-7c8a993e3811 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:56.278550 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b5799f94-298e-4ae6-8f4c-7c8a993e3811 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:56.279580 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b5799f94-298e-4ae6-8f4c-7c8a993e3811 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:56.280082 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-b5799f94-298e-4ae6-8f4c-7c8a993e3811 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:56.463663 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-b5799f94-298e-4ae6-8f4c-7c8a993e3811 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:56.472177 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-b5799f94-298e-4ae6-8f4c-7c8a993e3811 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 200 len: 1265 microversion: 2.1 time: 0.207054 Nov 23 07:51:56.473029 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 520/1093] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:56 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:51:56.601967 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d4d4591b-5472-4f4f-a407-11a3a3fb98bb tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Action: 'create', calling method: .version_select at 0x7f051469d3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-811809774"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:51:56.960149 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d4d4591b-5472-4f4f-a407-11a3a3fb98bb tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.493760 Nov 23 07:51:56.961047 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 574/1094] 10.222.0.48 () {60 vars in 1154 bytes} [Tue Nov 23 07:51:56 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 495 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 23 07:51:56.977015 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5bb5a85a-f587-4758-8dc6-34bdbf1f64c1 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Calling method '.version_select at 0x7f0507f9f940>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:57.041694 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5bb5a85a-f587-4758-8dc6-34bdbf1f64c1 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/26b45da1-f0d3-4934-9553-5743faaa51da" status: 200 len: 344 microversion: 2.1 time: 0.068744 Nov 23 07:51:57.042480 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 521/1095] 10.222.0.48 () {58 vars in 1244 bytes} [Tue Nov 23 07:51:56 2021] GET /compute/v2.1/os-volumes/26b45da1-f0d3-4934-9553-5743faaa51da => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:51:57.488800 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4be1f7e3-a097-495f-8c48-406e584a97d1 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:57.489508 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4be1f7e3-a097-495f-8c48-406e584a97d1 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:57.496081 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4be1f7e3-a097-495f-8c48-406e584a97d1 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:57.496524 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4be1f7e3-a097-495f-8c48-406e584a97d1 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:57.497335 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4be1f7e3-a097-495f-8c48-406e584a97d1 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:57.498330 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4be1f7e3-a097-495f-8c48-406e584a97d1 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:57.790326 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-4be1f7e3-a097-495f-8c48-406e584a97d1 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:57.798591 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4be1f7e3-a097-495f-8c48-406e584a97d1 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 200 len: 1265 microversion: 2.1 time: 0.313446 Nov 23 07:51:57.799168 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 575/1096] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:57 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:58.056423 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-2fb4a45e-b48e-4b3c-9fa3-c82f099452d2 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Calling method '.version_select at 0x7f0507ed93a0>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:58.104449 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-2fb4a45e-b48e-4b3c-9fa3-c82f099452d2 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/26b45da1-f0d3-4934-9553-5743faaa51da" status: 200 len: 345 microversion: 2.1 time: 0.052529 Nov 23 07:51:58.105009 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 522/1097] 10.222.0.48 () {58 vars in 1244 bytes} [Tue Nov 23 07:51:58 2021] GET /compute/v2.1/os-volumes/26b45da1-f0d3-4934-9553-5743faaa51da => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:51:58.117666 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c1e9ee80-fae8-4755-9f11-0966e23301e6 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Action: 'create', calling method: .version_select at 0x7f05145d35e0>, body: {"snapshot": {"volume_id": "26b45da1-f0d3-4934-9553-5743faaa51da", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-28374308"}} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:51:58.285508 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c1e9ee80-fae8-4755-9f11-0966e23301e6 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.171821 Nov 23 07:51:58.286144 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 576/1098] 10.222.0.48 () {60 vars in 1161 bytes} [Tue Nov 23 07:51:58 2021] POST /compute/v2.1/os-snapshots => generated 285 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:51:58.297911 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-e63b80f3-841c-4fc8-8b56-7e8b1c158f84 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Calling method '.version_select at 0x7f0507ed9c10>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:58.335692 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-e63b80f3-841c-4fc8-8b56-7e8b1c158f84 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/e0c3af47-e84b-46bf-baf2-a04d2a9c5a0b" status: 200 len: 285 microversion: 2.1 time: 0.043099 Nov 23 07:51:58.336589 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 523/1099] 10.222.0.48 () {58 vars in 1250 bytes} [Tue Nov 23 07:51:58 2021] GET /compute/v2.1/os-snapshots/e0c3af47-e84b-46bf-baf2-a04d2a9c5a0b => generated 285 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:51:58.347777 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-77b28b8d-e8b5-428f-b496-70678da759b7 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Calling method '.version_select at 0x7f05145d3430>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:58.379668 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-77b28b8d-e8b5-428f-b496-70678da759b7 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.036556 Nov 23 07:51:58.380235 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 577/1100] 10.222.0.48 () {58 vars in 1139 bytes} [Tue Nov 23 07:51:58 2021] GET /compute/v2.1/os-snapshots => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:51:58.390318 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-ed394ec4-7ab5-422c-940d-5ec4912e129b tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Calling method '.version_select at 0x7f0507ed9e50>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:58.422999 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-ed394ec4-7ab5-422c-940d-5ec4912e129b tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/e0c3af47-e84b-46bf-baf2-a04d2a9c5a0b" status: 200 len: 285 microversion: 2.1 time: 0.035933 Nov 23 07:51:58.424056 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 524/1101] 10.222.0.48 () {58 vars in 1250 bytes} [Tue Nov 23 07:51:58 2021] GET /compute/v2.1/os-snapshots/e0c3af47-e84b-46bf-baf2-a04d2a9c5a0b => generated 285 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:51:58.816482 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-0bec775f-a715-4105-a355-2f8fec4ec77f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:58.817089 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-0bec775f-a715-4105-a355-2f8fec4ec77f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:51:58.823381 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0bec775f-a715-4105-a355-2f8fec4ec77f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:58.823833 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0bec775f-a715-4105-a355-2f8fec4ec77f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:58.824640 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0bec775f-a715-4105-a355-2f8fec4ec77f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:51:58.825249 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0bec775f-a715-4105-a355-2f8fec4ec77f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:51:58.972603 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-0bec775f-a715-4105-a355-2f8fec4ec77f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:51:58.981076 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-0bec775f-a715-4105-a355-2f8fec4ec77f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 200 len: 1265 microversion: 2.1 time: 0.169180 Nov 23 07:51:58.981672 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 578/1102] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:58 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:51:59.435451 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-9a0dedb2-78bb-448b-bafb-3c8cd09112b9 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Calling method '.version_select at 0x7f05141e9a60>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:59.465767 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-9a0dedb2-78bb-448b-bafb-3c8cd09112b9 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/e0c3af47-e84b-46bf-baf2-a04d2a9c5a0b" status: 200 len: 285 microversion: 2.1 time: 0.034092 Nov 23 07:51:59.467324 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 525/1103] 10.222.0.48 () {58 vars in 1250 bytes} [Tue Nov 23 07:51:59 2021] GET /compute/v2.1/os-snapshots/e0c3af47-e84b-46bf-baf2-a04d2a9c5a0b => generated 285 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:51:59.998470 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a066845a-52f4-40b6-bedc-1ff9ab89a0d7 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:51:59.999153 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-a066845a-52f4-40b6-bedc-1ff9ab89a0d7 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:52:00.006222 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a066845a-52f4-40b6-bedc-1ff9ab89a0d7 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:00.006998 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a066845a-52f4-40b6-bedc-1ff9ab89a0d7 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:00.008479 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a066845a-52f4-40b6-bedc-1ff9ab89a0d7 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:00.009231 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-a066845a-52f4-40b6-bedc-1ff9ab89a0d7 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:00.164926 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-a066845a-52f4-40b6-bedc-1ff9ab89a0d7 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:52:00.173577 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a066845a-52f4-40b6-bedc-1ff9ab89a0d7 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 200 len: 1265 microversion: 2.1 time: 0.179251 Nov 23 07:52:00.174187 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 579/1104] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:51:59 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:52:00.480934 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3ead6159-c45c-49f5-a836-aaec826caa2c tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Calling method '.version_select at 0x7f0507fccdc0>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:00.511774 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3ead6159-c45c-49f5-a836-aaec826caa2c tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/e0c3af47-e84b-46bf-baf2-a04d2a9c5a0b" status: 200 len: 285 microversion: 2.1 time: 0.034970 Nov 23 07:52:00.512347 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 526/1105] 10.222.0.48 () {58 vars in 1250 bytes} [Tue Nov 23 07:52:00 2021] GET /compute/v2.1/os-snapshots/e0c3af47-e84b-46bf-baf2-a04d2a9c5a0b => generated 285 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:52:01.190573 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c9bc0f94-b4b8-4fd7-8d8d-74f4f940004e tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:01.191205 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-c9bc0f94-b4b8-4fd7-8d8d-74f4f940004e tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:52:01.197444 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c9bc0f94-b4b8-4fd7-8d8d-74f4f940004e tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:01.197936 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c9bc0f94-b4b8-4fd7-8d8d-74f4f940004e tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:01.198796 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c9bc0f94-b4b8-4fd7-8d8d-74f4f940004e tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:01.199165 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-c9bc0f94-b4b8-4fd7-8d8d-74f4f940004e tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:01.526769 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-62ada2af-ff03-4076-9684-e9b9dbc488f7 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Calling method '.version_select at 0x7f0507ed9af0>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:01.561907 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-62ada2af-ff03-4076-9684-e9b9dbc488f7 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/e0c3af47-e84b-46bf-baf2-a04d2a9c5a0b" status: 200 len: 286 microversion: 2.1 time: 0.040441 Nov 23 07:52:01.562632 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 527/1106] 10.222.0.48 () {58 vars in 1250 bytes} [Tue Nov 23 07:52:01 2021] GET /compute/v2.1/os-snapshots/e0c3af47-e84b-46bf-baf2-a04d2a9c5a0b => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:52:01.574717 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-74b12ad6-5046-46ff-8116-845221ac576e tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Calling method '.version_select at 0x7f0507f2d940>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:01.626062 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-c9bc0f94-b4b8-4fd7-8d8d-74f4f940004e tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:52:01.637633 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c9bc0f94-b4b8-4fd7-8d8d-74f4f940004e tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 200 len: 1265 microversion: 2.1 time: 0.450358 Nov 23 07:52:01.639218 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 580/1107] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:52:01 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 1265 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:52:01.640332 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-74b12ad6-5046-46ff-8116-845221ac576e tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/e0c3af47-e84b-46bf-baf2-a04d2a9c5a0b" status: 202 len: 0 microversion: 2.1 time: 0.069791 Nov 23 07:52:01.646404 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 528/1108] 10.222.0.48 () {58 vars in 1253 bytes} [Tue Nov 23 07:52:01 2021] DELETE /compute/v2.1/os-snapshots/e0c3af47-e84b-46bf-baf2-a04d2a9c5a0b => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:52:01.653252 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-9df34a74-6aec-4333-9fab-7a67ee27d356 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Calling method '.version_select at 0x7f051476d0d0>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:01.683036 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-9df34a74-6aec-4333-9fab-7a67ee27d356 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/e0c3af47-e84b-46bf-baf2-a04d2a9c5a0b" status: 200 len: 285 microversion: 2.1 time: 0.033567 Nov 23 07:52:01.683735 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 581/1109] 10.222.0.48 () {58 vars in 1250 bytes} [Tue Nov 23 07:52:01 2021] GET /compute/v2.1/os-snapshots/e0c3af47-e84b-46bf-baf2-a04d2a9c5a0b => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:52:02.656672 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-091d5d7a-d38c-48c4-9233-4bb801c561d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:02.657228 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-091d5d7a-d38c-48c4-9233-4bb801c561d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:52:02.664140 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-091d5d7a-d38c-48c4-9233-4bb801c561d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:02.664591 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-091d5d7a-d38c-48c4-9233-4bb801c561d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:02.665392 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-091d5d7a-d38c-48c4-9233-4bb801c561d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:02.665871 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-091d5d7a-d38c-48c4-9233-4bb801c561d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:02.695705 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-7cd57934-c0dd-470b-82b1-aa8778d499f4 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Calling method '.version_select at 0x7f051459dd30>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:02.733688 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-7cd57934-c0dd-470b-82b1-aa8778d499f4 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] HTTP exception thrown: Snapshot e0c3af47-e84b-46bf-baf2-a04d2a9c5a0b could not be found. Nov 23 07:52:02.734344 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-7cd57934-c0dd-470b-82b1-aa8778d499f4 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Returning 404 to user: Snapshot e0c3af47-e84b-46bf-baf2-a04d2a9c5a0b could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:52:02.735182 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-7cd57934-c0dd-470b-82b1-aa8778d499f4 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/e0c3af47-e84b-46bf-baf2-a04d2a9c5a0b" status: 404 len: 111 microversion: 2.1 time: 0.043747 Nov 23 07:52:02.735976 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 582/1110] 10.222.0.48 () {58 vars in 1250 bytes} [Tue Nov 23 07:52:02 2021] GET /compute/v2.1/os-snapshots/e0c3af47-e84b-46bf-baf2-a04d2a9c5a0b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 07:52:02.746175 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c5bf549c-9905-4c31-ae95-1e43950e4e33 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Calling method '.version_select at 0x7f051476de50>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:02.823988 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c5bf549c-9905-4c31-ae95-1e43950e4e33 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/26b45da1-f0d3-4934-9553-5743faaa51da" status: 202 len: 0 microversion: 2.1 time: 0.082849 Nov 23 07:52:02.830306 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 583/1111] 10.222.0.48 () {58 vars in 1247 bytes} [Tue Nov 23 07:52:02 2021] DELETE /compute/v2.1/os-volumes/26b45da1-f0d3-4934-9553-5743faaa51da => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 07:52:02.835932 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-16c6fca0-55bb-4842-939d-ce07b5e6ef4f tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Calling method '.version_select at 0x7f051459d820>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:02.859130 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-091d5d7a-d38c-48c4-9233-4bb801c561d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:52:02.868544 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-091d5d7a-d38c-48c4-9233-4bb801c561d0 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 200 len: 1265 microversion: 2.1 time: 0.216183 Nov 23 07:52:02.869356 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 529/1112] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:52:02 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:52:02.897947 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-16c6fca0-55bb-4842-939d-ce07b5e6ef4f tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/26b45da1-f0d3-4934-9553-5743faaa51da" status: 200 len: 344 microversion: 2.1 time: 0.066271 Nov 23 07:52:02.898549 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 584/1113] 10.222.0.48 () {58 vars in 1244 bytes} [Tue Nov 23 07:52:02 2021] GET /compute/v2.1/os-volumes/26b45da1-f0d3-4934-9553-5743faaa51da => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:52:03.891986 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-75bbaf77-0c9d-4771-99aa-f716ef623ade tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:03.892712 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-75bbaf77-0c9d-4771-99aa-f716ef623ade tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:52:03.899651 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-75bbaf77-0c9d-4771-99aa-f716ef623ade tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:03.900100 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-75bbaf77-0c9d-4771-99aa-f716ef623ade tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:03.900884 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-75bbaf77-0c9d-4771-99aa-f716ef623ade tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:03.901307 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-75bbaf77-0c9d-4771-99aa-f716ef623ade tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:03.911363 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-45e4af60-b54e-48d0-81be-008c5cc5eba9 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Calling method '.version_select at 0x7f05145d35e0>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:03.941964 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-45e4af60-b54e-48d0-81be-008c5cc5eba9 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] HTTP exception thrown: Volume 26b45da1-f0d3-4934-9553-5743faaa51da could not be found. Nov 23 07:52:03.943343 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-45e4af60-b54e-48d0-81be-008c5cc5eba9 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Returning 404 to user: Volume 26b45da1-f0d3-4934-9553-5743faaa51da could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:52:03.944508 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-45e4af60-b54e-48d0-81be-008c5cc5eba9 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/26b45da1-f0d3-4934-9553-5743faaa51da" status: 404 len: 109 microversion: 2.1 time: 0.037448 Nov 23 07:52:03.945280 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 585/1114] 10.222.0.48 () {58 vars in 1244 bytes} [Tue Nov 23 07:52:03 2021] GET /compute/v2.1/os-volumes/26b45da1-f0d3-4934-9553-5743faaa51da => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:52:03.955501 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c4dab82f-4ad6-49de-aa40-08d849c5f16d tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Calling method '.version_select at 0x7f05145d39d0>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:03.983158 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-c4dab82f-4ad6-49de-aa40-08d849c5f16d tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] HTTP exception thrown: Volume 26b45da1-f0d3-4934-9553-5743faaa51da could not be found. Nov 23 07:52:03.983901 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-c4dab82f-4ad6-49de-aa40-08d849c5f16d tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Returning 404 to user: Volume 26b45da1-f0d3-4934-9553-5743faaa51da could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:52:03.984872 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-c4dab82f-4ad6-49de-aa40-08d849c5f16d tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/26b45da1-f0d3-4934-9553-5743faaa51da" status: 404 len: 109 microversion: 2.1 time: 0.033312 Nov 23 07:52:03.986044 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 586/1115] 10.222.0.48 () {58 vars in 1247 bytes} [Tue Nov 23 07:52:03 2021] DELETE /compute/v2.1/os-volumes/26b45da1-f0d3-4934-9553-5743faaa51da => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 07:52:03.997986 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-78391c9a-90fe-4b39-be13-56cff89dd653 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Calling method '.version_select at 0x7f051476ddc0>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:04.026391 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-78391c9a-90fe-4b39-be13-56cff89dd653 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] HTTP exception thrown: Volume 26b45da1-f0d3-4934-9553-5743faaa51da could not be found. Nov 23 07:52:04.026998 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-78391c9a-90fe-4b39-be13-56cff89dd653 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] Returning 404 to user: Volume 26b45da1-f0d3-4934-9553-5743faaa51da could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:52:04.027842 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-78391c9a-90fe-4b39-be13-56cff89dd653 tempest-VolumesSnapshotsTestJSON-338720489 tempest-VolumesSnapshotsTestJSON-338720489-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/26b45da1-f0d3-4934-9553-5743faaa51da" status: 404 len: 109 microversion: 2.1 time: 0.036713 Nov 23 07:52:04.028430 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 587/1116] 10.222.0.48 () {58 vars in 1244 bytes} [Tue Nov 23 07:52:03 2021] GET /compute/v2.1/os-volumes/26b45da1-f0d3-4934-9553-5743faaa51da => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 07:52:04.055590 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-75bbaf77-0c9d-4771-99aa-f716ef623ade tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:52:04.066463 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-75bbaf77-0c9d-4771-99aa-f716ef623ade tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 200 len: 1265 microversion: 2.1 time: 0.178747 Nov 23 07:52:04.067270 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 530/1117] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:52:03 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:52:05.086182 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-19b73e1b-7bcc-42ae-acf0-d96caae10d6d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:05.086890 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-19b73e1b-7bcc-42ae-acf0-d96caae10d6d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:52:05.096446 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-19b73e1b-7bcc-42ae-acf0-d96caae10d6d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:05.096897 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-19b73e1b-7bcc-42ae-acf0-d96caae10d6d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:05.097673 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-19b73e1b-7bcc-42ae-acf0-d96caae10d6d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:05.098132 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-19b73e1b-7bcc-42ae-acf0-d96caae10d6d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:05.259669 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-19b73e1b-7bcc-42ae-acf0-d96caae10d6d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:52:05.269648 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-19b73e1b-7bcc-42ae-acf0-d96caae10d6d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 200 len: 1265 microversion: 2.1 time: 0.186902 Nov 23 07:52:05.270497 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 588/1118] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:52:05 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:52:06.289132 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-74c10c11-5cb0-4fd8-a50d-cf38526c5509 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:06.289847 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-74c10c11-5cb0-4fd8-a50d-cf38526c5509 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:52:06.297203 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-74c10c11-5cb0-4fd8-a50d-cf38526c5509 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:06.297742 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-74c10c11-5cb0-4fd8-a50d-cf38526c5509 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:06.298557 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-74c10c11-5cb0-4fd8-a50d-cf38526c5509 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:06.298992 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-74c10c11-5cb0-4fd8-a50d-cf38526c5509 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:06.451322 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-74c10c11-5cb0-4fd8-a50d-cf38526c5509 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:52:06.459668 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-74c10c11-5cb0-4fd8-a50d-cf38526c5509 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 200 len: 1265 microversion: 2.1 time: 0.174831 Nov 23 07:52:06.460270 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 531/1119] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:52:06 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:52:06.846372 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [req-6a63b1a8-5ae2-4f93-a2a4-f885562aa0ed req-b53f523e-1f4c-4994-966a-3463442eb264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18f5dd9-65e2-499f-94d9-4d2b8a657e1a", "name": "network-vif-plugged", "status": "completed", "tag": "9e3b2c21-6496-4e46-b7a3-80855a393bc3"}]} {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:52:06.848055 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:52:06.848055 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: warnings.warn(msg) Nov 23 07:52:06.855704 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-6a63b1a8-5ae2-4f93-a2a4-f885562aa0ed req-b53f523e-1f4c-4994-966a-3463442eb264 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:06.856173 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [req-6a63b1a8-5ae2-4f93-a2a4-f885562aa0ed req-b53f523e-1f4c-4994-966a-3463442eb264 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:06.868733 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.compute.server_external_events [req-6a63b1a8-5ae2-4f93-a2a4-f885562aa0ed req-b53f523e-1f4c-4994-966a-3463442eb264 service nova] Creating event network-vif-plugged:9e3b2c21-6496-4e46-b7a3-80855a393bc3 for instance e18f5dd9-65e2-499f-94d9-4d2b8a657e1a on hv-cinder-80403 Nov 23 07:52:06.874758 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [req-6a63b1a8-5ae2-4f93-a2a4-f885562aa0ed req-b53f523e-1f4c-4994-966a-3463442eb264 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031894 Nov 23 07:52:06.875456 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 589/1120] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:52:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:52:07.121013 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-fc651cda-4b85-46ec-ac2f-593e6894841a tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] Calling method '.version_select at 0x7f0507ed9ee0>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:07.179559 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-fc651cda-4b85-46ec-ac2f-593e6894841a tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/fa329cb3-d620-4479-a6c4-d524de9338c6" status: 200 len: 351 microversion: 2.1 time: 0.062315 Nov 23 07:52:07.180251 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 532/1121] 10.222.0.48 () {58 vars in 1244 bytes} [Tue Nov 23 07:52:07 2021] GET /compute/v2.1/os-volumes/fa329cb3-d620-4479-a6c4-d524de9338c6 => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:52:07.479206 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-6e5d1c4d-03e1-490b-a8d5-72075fd77652 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:07.479919 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-6e5d1c4d-03e1-490b-a8d5-72075fd77652 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:52:07.486826 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6e5d1c4d-03e1-490b-a8d5-72075fd77652 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:07.487283 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6e5d1c4d-03e1-490b-a8d5-72075fd77652 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:07.488224 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6e5d1c4d-03e1-490b-a8d5-72075fd77652 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:07.488664 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-6e5d1c4d-03e1-490b-a8d5-72075fd77652 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:07.648673 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-6e5d1c4d-03e1-490b-a8d5-72075fd77652 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:52:07.656644 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-6e5d1c4d-03e1-490b-a8d5-72075fd77652 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 200 len: 1265 microversion: 2.1 time: 0.181860 Nov 23 07:52:07.657225 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 590/1122] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:52:07 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:52:08.509795 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-9855bc14-3ff9-4ffe-9dec-cd57d0af22fc tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] Calling method '.version_select at 0x7f0507fab160>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:08.562286 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-9855bc14-3ff9-4ffe-9dec-cd57d0af22fc tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/af4d690c-6c49-49d8-9825-5db935a70a46" status: 200 len: 351 microversion: 2.1 time: 0.056620 Nov 23 07:52:08.563192 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 533/1123] 10.222.0.48 () {58 vars in 1244 bytes} [Tue Nov 23 07:52:08 2021] GET /compute/v2.1/os-volumes/af4d690c-6c49-49d8-9825-5db935a70a46 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:52:08.680418 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-46efb5f4-d24d-4598-ab1d-eb23b934e580 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:08.681584 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-46efb5f4-d24d-4598-ab1d-eb23b934e580 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:52:08.694594 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-46efb5f4-d24d-4598-ab1d-eb23b934e580 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:08.695501 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-46efb5f4-d24d-4598-ab1d-eb23b934e580 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:08.697179 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-46efb5f4-d24d-4598-ab1d-eb23b934e580 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:08.698294 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-46efb5f4-d24d-4598-ab1d-eb23b934e580 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:08.877538 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-46efb5f4-d24d-4598-ab1d-eb23b934e580 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:52:08.898067 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-46efb5f4-d24d-4598-ab1d-eb23b934e580 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 200 len: 1451 microversion: 2.1 time: 0.224918 Nov 23 07:52:08.898660 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 591/1124] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:52:08 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 1451 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:52:08.915047 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-e238d757-542c-481f-983f-24068d697f6d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:08.915663 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-e238d757-542c-481f-983f-24068d697f6d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:52:08.924395 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e238d757-542c-481f-983f-24068d697f6d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:08.924841 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e238d757-542c-481f-983f-24068d697f6d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:08.925632 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e238d757-542c-481f-983f-24068d697f6d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:08.926116 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-e238d757-542c-481f-983f-24068d697f6d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:09.083481 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-e238d757-542c-481f-983f-24068d697f6d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:52:09.091101 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-e238d757-542c-481f-983f-24068d697f6d tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 200 len: 1451 microversion: 2.1 time: 0.179738 Nov 23 07:52:09.091679 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 534/1125] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:52:08 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 1451 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:52:09.959008 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-73375694-32d3-4379-aa04-969dc5ede1fd tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] Calling method '.version_select at 0x7f051476d790>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:10.016555 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-73375694-32d3-4379-aa04-969dc5ede1fd tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/280bf010-ade1-4839-8436-e98f51645006" status: 200 len: 351 microversion: 2.1 time: 0.061304 Nov 23 07:52:10.017132 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 592/1126] 10.222.0.48 () {58 vars in 1244 bytes} [Tue Nov 23 07:52:09 2021] GET /compute/v2.1/os-volumes/280bf010-ade1-4839-8436-e98f51645006 => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:52:10.029064 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-6e5f9e3d-e72a-498e-8c47-5ab3389faaaf tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] Calling method '.version_select at 0x7f0507ed9430>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:10.115853 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-6e5f9e3d-e72a-498e-8c47-5ab3389faaaf tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.090912 Nov 23 07:52:10.116526 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 535/1127] 10.222.0.48 () {58 vars in 1133 bytes} [Tue Nov 23 07:52:10 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:52:10.128965 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-123712c6-e21e-4c12-b180-11fa2f2aaab1 tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] Calling method '.version_select at 0x7f05149e8d30>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:10.215483 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-123712c6-e21e-4c12-b180-11fa2f2aaab1 tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.089826 Nov 23 07:52:10.216878 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 593/1128] 10.222.0.48 () {58 vars in 1148 bytes} [Tue Nov 23 07:52:10 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:52:10.231055 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f8ffce56-22a7-42ef-b4a8-6b57e803c0f2 tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] Calling method '.version_select at 0x7f0507f59550>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:10.321332 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f8ffce56-22a7-42ef-b4a8-6b57e803c0f2 tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.095447 Nov 23 07:52:10.321954 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 536/1129] 10.222.0.48 () {58 vars in 1133 bytes} [Tue Nov 23 07:52:10 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:52:10.333912 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-8633c266-0f1b-41b7-9b0b-d54722f60cac tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] Calling method '.version_select at 0x7f0514697040>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:10.417600 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-8633c266-0f1b-41b7-9b0b-d54722f60cac tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087707 Nov 23 07:52:10.418210 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 594/1130] 10.222.0.48 () {58 vars in 1166 bytes} [Tue Nov 23 07:52:10 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:52:10.429813 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-bdb5ff6d-88d9-4a95-9abc-d390e513308f tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] Calling method '.version_select at 0x7f05141db8b0>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:10.511122 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-bdb5ff6d-88d9-4a95-9abc-d390e513308f tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085024 Nov 23 07:52:10.511698 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 537/1131] 10.222.0.48 () {58 vars in 1169 bytes} [Tue Nov 23 07:52:10 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:52:10.524023 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-5cb5238a-6da6-4730-adf3-bedcb065e186 tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] Calling method '.version_select at 0x7f051459d430>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:10.605357 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-5cb5238a-6da6-4730-adf3-bedcb065e186 tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.084839 Nov 23 07:52:10.605953 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 595/1132] 10.222.0.48 () {58 vars in 1154 bytes} [Tue Nov 23 07:52:10 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:52:10.617549 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-55e9c65d-1120-487e-9d30-c2c32284b2c4 tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] Calling method '.version_select at 0x7f0507ed9d30>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:10.708808 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-55e9c65d-1120-487e-9d30-c2c32284b2c4 tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.094774 Nov 23 07:52:10.709402 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 538/1133] 10.222.0.48 () {58 vars in 1187 bytes} [Tue Nov 23 07:52:10 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:52:10.721042 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-a1c45ba8-5a37-452c-940d-b16c82cf92db tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] Calling method '.version_select at 0x7f051476da60>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:52:10.852394 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-a1c45ba8-5a37-452c-940d-b16c82cf92db tempest-VolumesTestJSON-544647690 tempest-VolumesTestJSON-544647690-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.135020 Nov 23 07:52:10.852971 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 596/1134] 10.222.0.48 () {58 vars in 1154 bytes} [Tue Nov 23 07:52:10 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:52:10.890386 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-011f5a01-fc4a-429a-9f2a-322c63c29b6d req-4a721c9f-7f8c-44bc-82fd-740e443933f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18f5dd9-65e2-499f-94d9-4d2b8a657e1a", "tag": "9e3b2c21-6496-4e46-b7a3-80855a393bc3"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:52:10.890386 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:52:10.890386 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:52:10.898550 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-011f5a01-fc4a-429a-9f2a-322c63c29b6d req-4a721c9f-7f8c-44bc-82fd-740e443933f5 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:52:10.898998 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-011f5a01-fc4a-429a-9f2a-322c63c29b6d req-4a721c9f-7f8c-44bc-82fd-740e443933f5 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:52:10.910721 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-011f5a01-fc4a-429a-9f2a-322c63c29b6d req-4a721c9f-7f8c-44bc-82fd-740e443933f5 service nova] Creating event network-changed:9e3b2c21-6496-4e46-b7a3-80855a393bc3 for instance e18f5dd9-65e2-499f-94d9-4d2b8a657e1a on hv-cinder-80403 Nov 23 07:52:10.916452 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-011f5a01-fc4a-429a-9f2a-322c63c29b6d req-4a721c9f-7f8c-44bc-82fd-740e443933f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034183 Nov 23 07:52:10.917954 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 539/1135] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:52:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:53:09.034389 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4f20f2ae-b6e4-4314-83e3-ed8690971a07 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:53:09.035502 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4f20f2ae-b6e4-4314-83e3-ed8690971a07 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:53:09.038177 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-aacaf168-040c-4cf5-aa0c-905d2e1b26c1 req-7af9bf5e-ed79-4d5c-9483-690400d8dc0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be38773-5840-4e15-b2f5-ce77caceb858", "tag": "a7bd6f41-4ac3-41e3-8d6f-dd2993595bc7"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:53:09.039645 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:53:09.039645 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:53:09.042495 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4f20f2ae-b6e4-4314-83e3-ed8690971a07 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:53:09.042945 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4f20f2ae-b6e4-4314-83e3-ed8690971a07 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:53:09.044067 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4f20f2ae-b6e4-4314-83e3-ed8690971a07 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:53:09.044538 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4f20f2ae-b6e4-4314-83e3-ed8690971a07 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:53:09.047685 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-aacaf168-040c-4cf5-aa0c-905d2e1b26c1 req-7af9bf5e-ed79-4d5c-9483-690400d8dc0d service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:53:09.048133 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-aacaf168-040c-4cf5-aa0c-905d2e1b26c1 req-7af9bf5e-ed79-4d5c-9483-690400d8dc0d service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:53:09.071964 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-aacaf168-040c-4cf5-aa0c-905d2e1b26c1 req-7af9bf5e-ed79-4d5c-9483-690400d8dc0d service nova] Creating event network-changed:a7bd6f41-4ac3-41e3-8d6f-dd2993595bc7 for instance 4be38773-5840-4e15-b2f5-ce77caceb858 on hv-cinder-80403 Nov 23 07:53:09.072764 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4f20f2ae-b6e4-4314-83e3-ed8690971a07 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Going to try to terminate instance {{(pid=122786) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:53:09.079715 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-aacaf168-040c-4cf5-aa0c-905d2e1b26c1 req-7af9bf5e-ed79-4d5c-9483-690400d8dc0d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046481 Nov 23 07:53:09.081002 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 540/1136] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:53:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:53:09.177433 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4f20f2ae-b6e4-4314-83e3-ed8690971a07 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 204 len: 0 microversion: 2.1 time: 0.146845 Nov 23 07:53:09.181358 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 597/1137] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:53:09 2021] DELETE /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 07:53:09.187466 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5a9b9097-5406-4266-8496-306d71726812 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:53:09.188160 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5a9b9097-5406-4266-8496-306d71726812 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:53:09.194489 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5a9b9097-5406-4266-8496-306d71726812 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:53:09.195371 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5a9b9097-5406-4266-8496-306d71726812 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:53:09.196331 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5a9b9097-5406-4266-8496-306d71726812 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:53:09.196919 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5a9b9097-5406-4266-8496-306d71726812 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:53:09.625139 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5a9b9097-5406-4266-8496-306d71726812 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:53:09.632757 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5a9b9097-5406-4266-8496-306d71726812 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1568 microversion: 2.1 time: 0.449803 Nov 23 07:53:09.633458 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 541/1138] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:53:09 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1568 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:53:09.735506 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 07:53:09.735697 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: Tue Nov 23 07:53:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 07:53:10.650238 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-db2ffe6b-6eaa-4ab9-ac98-e0d9a6e343ae tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:53:10.650903 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-db2ffe6b-6eaa-4ab9-ac98-e0d9a6e343ae tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:53:10.658904 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-db2ffe6b-6eaa-4ab9-ac98-e0d9a6e343ae tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:53:10.659353 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-db2ffe6b-6eaa-4ab9-ac98-e0d9a6e343ae tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:53:10.660126 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-db2ffe6b-6eaa-4ab9-ac98-e0d9a6e343ae tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:53:10.660561 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-db2ffe6b-6eaa-4ab9-ac98-e0d9a6e343ae tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:53:10.848659 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-db2ffe6b-6eaa-4ab9-ac98-e0d9a6e343ae tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:53:10.856164 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-db2ffe6b-6eaa-4ab9-ac98-e0d9a6e343ae tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1450 microversion: 2.1 time: 0.210122 Nov 23 07:53:10.856807 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 598/1139] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:53:10 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1450 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:53:11.455838 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-db6e2cc1-0a17-453b-befc-b43cbf6c8b98 req-be5799c0-b7ba-4785-916b-980decb1f52b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be38773-5840-4e15-b2f5-ce77caceb858", "name": "network-vif-deleted", "tag": "a7bd6f41-4ac3-41e3-8d6f-dd2993595bc7"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:53:11.455838 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:53:11.455838 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:53:11.463890 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-db6e2cc1-0a17-453b-befc-b43cbf6c8b98 req-be5799c0-b7ba-4785-916b-980decb1f52b service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:53:11.464455 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-db6e2cc1-0a17-453b-befc-b43cbf6c8b98 req-be5799c0-b7ba-4785-916b-980decb1f52b service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:53:11.481039 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-db6e2cc1-0a17-453b-befc-b43cbf6c8b98 req-be5799c0-b7ba-4785-916b-980decb1f52b service nova] Creating event network-vif-deleted:a7bd6f41-4ac3-41e3-8d6f-dd2993595bc7 for instance 4be38773-5840-4e15-b2f5-ce77caceb858 on hv-cinder-80403 Nov 23 07:53:11.488204 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-db6e2cc1-0a17-453b-befc-b43cbf6c8b98 req-be5799c0-b7ba-4785-916b-980decb1f52b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038364 Nov 23 07:53:11.489734 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 542/1140] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:53:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:53:11.874328 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-998439cd-e9fc-4729-ba8c-56f5a7059654 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:53:11.875914 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-998439cd-e9fc-4729-ba8c-56f5a7059654 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:53:11.888508 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-998439cd-e9fc-4729-ba8c-56f5a7059654 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:53:11.889249 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-998439cd-e9fc-4729-ba8c-56f5a7059654 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:53:11.890466 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-998439cd-e9fc-4729-ba8c-56f5a7059654 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:53:11.891266 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-998439cd-e9fc-4729-ba8c-56f5a7059654 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:53:11.976054 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-998439cd-e9fc-4729-ba8c-56f5a7059654 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e051a1a3934a12a2485cf6a2504932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d805701d3af40f59df0733595904769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:53:11.987667 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-998439cd-e9fc-4729-ba8c-56f5a7059654 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 200 len: 1220 microversion: 2.1 time: 0.116994 Nov 23 07:53:11.988554 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 599/1141] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:53:11 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 1220 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:53:13.005130 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-70e83132-3b8b-478d-833c-a99f9242f376 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:53:13.005851 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-70e83132-3b8b-478d-833c-a99f9242f376 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] [instance: 4be38773-5840-4e15-b2f5-ce77caceb858] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:53:13.012772 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-70e83132-3b8b-478d-833c-a99f9242f376 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:53:13.013851 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-70e83132-3b8b-478d-833c-a99f9242f376 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:53:13.014662 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-70e83132-3b8b-478d-833c-a99f9242f376 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:53:13.015098 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-70e83132-3b8b-478d-833c-a99f9242f376 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:53:13.029150 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-70e83132-3b8b-478d-833c-a99f9242f376 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] HTTP exception thrown: Instance 4be38773-5840-4e15-b2f5-ce77caceb858 could not be found. Nov 23 07:53:13.029776 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-70e83132-3b8b-478d-833c-a99f9242f376 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Returning 404 to user: Instance 4be38773-5840-4e15-b2f5-ce77caceb858 could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:53:13.031365 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-70e83132-3b8b-478d-833c-a99f9242f376 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858" status: 404 len: 111 microversion: 2.1 time: 0.029527 Nov 23 07:53:13.032656 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 543/1142] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:53:12 2021] GET /compute/v2.1/servers/4be38773-5840-4e15-b2f5-ce77caceb858 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:53:13.215397 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1f92c91c-27b3-4082-a83d-c13b86416ee3 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] Calling method '.version_select at 0x7f05149e8d30>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:53:13.241029 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1f92c91c-27b3-4082-a83d-c13b86416ee3 tempest-TestShelveInstance-531147269 tempest-TestShelveInstance-531147269-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1953697943" status: 202 len: 0 microversion: 2.1 time: 0.029215 Nov 23 07:53:13.241955 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 600/1143] 10.222.0.48 () {58 vars in 1253 bytes} [Tue Nov 23 07:53:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1953697943 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:54:10.164745 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-3cae035b-f854-4ccb-b297-8c0e8dbc8cec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1674910542", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-592728128", "security_groups": [{"name": "tempest-secgroup-smoke-1517785560"}], "block_device_mapping_v2": [{"uuid": "67ed0978-65d2-4b56-8a1d-f082e267793b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c4affbc5-6672-4357-8ba0-5a39b14c7726"}]}} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:54:10.290679 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.network.neutron [None req-3cae035b-f854-4ccb-b297-8c0e8dbc8cec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] validate_networks() for [('c4affbc5-6672-4357-8ba0-5a39b14c7726', None, None, None, None, None)] {{(pid=122785) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 07:54:11.000618 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-3cae035b-f854-4ccb-b297-8c0e8dbc8cec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Flavor limits 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 07:54:11.001033 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-3cae035b-f854-4ccb-b297-8c0e8dbc8cec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Image limits 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 07:54:11.001499 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-3cae035b-f854-4ccb-b297-8c0e8dbc8cec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Flavor pref 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 07:54:11.001940 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-3cae035b-f854-4ccb-b297-8c0e8dbc8cec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Image pref 0:0:0 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 07:54:11.002348 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.virt.hardware [None req-3cae035b-f854-4ccb-b297-8c0e8dbc8cec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 07:54:11.010807 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3cae035b-f854-4ccb-b297-8c0e8dbc8cec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:11.011249 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3cae035b-f854-4ccb-b297-8c0e8dbc8cec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:11.012053 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3cae035b-f854-4ccb-b297-8c0e8dbc8cec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:11.012483 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-3cae035b-f854-4ccb-b297-8c0e8dbc8cec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:11.029842 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-3cae035b-f854-4ccb-b297-8c0e8dbc8cec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Getting quotas for project 923ced17fbea41d2bb472b52dd316477. Resources: {'instances', 'cores', 'ram'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 07:54:11.034088 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.quota [None req-3cae035b-f854-4ccb-b297-8c0e8dbc8cec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Getting quotas for user cbb14b561f25411684be4c930e712800 and project 923ced17fbea41d2bb472b52dd316477. Resources: {'instances', 'cores', 'ram'} {{(pid=122785) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 07:54:11.091997 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3cae035b-f854-4ccb-b297-8c0e8dbc8cec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Going to run 1 instances... {{(pid=122785) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 07:54:11.094266 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-3cae035b-f854-4ccb-b297-8c0e8dbc8cec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='67ed0978-65d2-4b56-8a1d-f082e267793b',volume_size=None,volume_type=None)] {{(pid=122785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 07:54:11.210189 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3cae035b-f854-4ccb-b297-8c0e8dbc8cec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [c2ac9fa3-e449-4b6a-a8ed-dd65c969aed8] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 23 07:54:12.227122 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO oslo.messaging._drivers.impl_rabbit [None req-3cae035b-f854-4ccb-b297-8c0e8dbc8cec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [c2ac9fa3-e449-4b6a-a8ed-dd65c969aed8] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 46388. Nov 23 07:54:12.230882 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-3cae035b-f854-4ccb-b297-8c0e8dbc8cec tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.069861 Nov 23 07:54:12.231524 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 544/1144] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Nov 23 07:54:10 2021] POST /compute/v2.1/servers => generated 406 bytes in 2071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 07:54:12.242013 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-7e5fb61e-8b90-4dc1-9d22-31cb3682797c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:54:12.242625 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-7e5fb61e-8b90-4dc1-9d22-31cb3682797c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:54:12.296528 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-7e5fb61e-8b90-4dc1-9d22-31cb3682797c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:54:12.302181 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-7e5fb61e-8b90-4dc1-9d22-31cb3682797c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 200 len: 1094 microversion: 2.1 time: 0.064428 Nov 23 07:54:12.302742 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 601/1145] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:54:12 2021] GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:54:13.319480 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5744eb30-c8c2-4c51-bc19-acfbc9d04072 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:54:13.320115 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5744eb30-c8c2-4c51-bc19-acfbc9d04072 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:54:13.326500 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5744eb30-c8c2-4c51-bc19-acfbc9d04072 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:13.326936 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5744eb30-c8c2-4c51-bc19-acfbc9d04072 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:13.327720 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5744eb30-c8c2-4c51-bc19-acfbc9d04072 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:13.328412 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5744eb30-c8c2-4c51-bc19-acfbc9d04072 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:13.411542 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5744eb30-c8c2-4c51-bc19-acfbc9d04072 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:54:13.419738 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5744eb30-c8c2-4c51-bc19-acfbc9d04072 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 200 len: 1200 microversion: 2.1 time: 0.104332 Nov 23 07:54:13.420493 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 545/1146] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:54:13 2021] GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 1200 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:54:14.436666 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-85664961-7d06-43be-812c-d87a4b29642f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:54:14.437966 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-85664961-7d06-43be-812c-d87a4b29642f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:54:14.444995 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-85664961-7d06-43be-812c-d87a4b29642f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:14.445492 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-85664961-7d06-43be-812c-d87a4b29642f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:14.446572 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-85664961-7d06-43be-812c-d87a4b29642f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:14.447044 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-85664961-7d06-43be-812c-d87a4b29642f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:14.639513 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-85664961-7d06-43be-812c-d87a4b29642f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:54:14.648115 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-85664961-7d06-43be-812c-d87a4b29642f tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 200 len: 1266 microversion: 2.1 time: 0.215183 Nov 23 07:54:14.658651 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 602/1147] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:54:14 2021] GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:54:14.928669 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-4a7998c6-9f26-42ce-9f90-502a27d4304d req-ff4ff905-ee3d-45e1-bb9b-3a9b8d1b7780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c17bd508-168c-424a-bcf3-6145c780cc4a", "tag": "ea625575-2852-4b8b-940c-bec1d9c9bfb1"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:54:14.931233 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:54:14.931233 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:54:14.940272 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-4a7998c6-9f26-42ce-9f90-502a27d4304d req-ff4ff905-ee3d-45e1-bb9b-3a9b8d1b7780 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:14.940753 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-4a7998c6-9f26-42ce-9f90-502a27d4304d req-ff4ff905-ee3d-45e1-bb9b-3a9b8d1b7780 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:14.953323 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-4a7998c6-9f26-42ce-9f90-502a27d4304d req-ff4ff905-ee3d-45e1-bb9b-3a9b8d1b7780 service nova] Creating event network-changed:ea625575-2852-4b8b-940c-bec1d9c9bfb1 for instance c17bd508-168c-424a-bcf3-6145c780cc4a on hv-cinder-80403 Nov 23 07:54:14.966871 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-4a7998c6-9f26-42ce-9f90-502a27d4304d req-ff4ff905-ee3d-45e1-bb9b-3a9b8d1b7780 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198866 Nov 23 07:54:14.969041 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 546/1148] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:54:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:54:15.667325 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4018e818-92a1-42d9-ae20-924a8d67e095 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:54:15.668072 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4018e818-92a1-42d9-ae20-924a8d67e095 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:54:15.675099 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4018e818-92a1-42d9-ae20-924a8d67e095 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:15.675543 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4018e818-92a1-42d9-ae20-924a8d67e095 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:15.676337 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4018e818-92a1-42d9-ae20-924a8d67e095 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:15.676763 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4018e818-92a1-42d9-ae20-924a8d67e095 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:15.823862 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-4018e818-92a1-42d9-ae20-924a8d67e095 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:54:15.832273 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4018e818-92a1-42d9-ae20-924a8d67e095 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 200 len: 1266 microversion: 2.1 time: 0.168697 Nov 23 07:54:15.833292 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 603/1149] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:54:15 2021] GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:54:16.850882 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d63eddbb-097d-4da0-a32f-d1a052f1406b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:54:16.852201 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d63eddbb-097d-4da0-a32f-d1a052f1406b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:54:16.863283 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d63eddbb-097d-4da0-a32f-d1a052f1406b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:16.864094 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d63eddbb-097d-4da0-a32f-d1a052f1406b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:16.865469 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d63eddbb-097d-4da0-a32f-d1a052f1406b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:16.866313 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d63eddbb-097d-4da0-a32f-d1a052f1406b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:17.043830 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d63eddbb-097d-4da0-a32f-d1a052f1406b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:54:17.052113 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d63eddbb-097d-4da0-a32f-d1a052f1406b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 200 len: 1266 microversion: 2.1 time: 0.205678 Nov 23 07:54:17.052711 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 547/1150] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:54:16 2021] GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:54:18.070898 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-5af67921-7295-440e-a42a-c9176ca80116 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:54:18.071510 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-5af67921-7295-440e-a42a-c9176ca80116 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:54:18.078236 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5af67921-7295-440e-a42a-c9176ca80116 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:18.079188 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5af67921-7295-440e-a42a-c9176ca80116 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:18.079480 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5af67921-7295-440e-a42a-c9176ca80116 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:18.079919 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-5af67921-7295-440e-a42a-c9176ca80116 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:18.216531 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-5af67921-7295-440e-a42a-c9176ca80116 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:54:18.226248 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-5af67921-7295-440e-a42a-c9176ca80116 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 200 len: 1266 microversion: 2.1 time: 0.158769 Nov 23 07:54:18.226989 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 604/1151] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:54:18 2021] GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:54:19.244479 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-f1873376-2d32-47d4-90b9-966ce66bab10 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:54:19.245076 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-f1873376-2d32-47d4-90b9-966ce66bab10 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:54:19.252032 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f1873376-2d32-47d4-90b9-966ce66bab10 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:19.252499 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f1873376-2d32-47d4-90b9-966ce66bab10 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:19.253281 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f1873376-2d32-47d4-90b9-966ce66bab10 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:19.253753 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-f1873376-2d32-47d4-90b9-966ce66bab10 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:19.413000 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-f1873376-2d32-47d4-90b9-966ce66bab10 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:54:19.420842 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-f1873376-2d32-47d4-90b9-966ce66bab10 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 200 len: 1266 microversion: 2.1 time: 0.180171 Nov 23 07:54:19.421497 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 548/1152] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:54:19 2021] GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:54:20.439085 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-cf2aa695-5ce6-4a03-8577-616b13ee5d06 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:54:20.439663 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-cf2aa695-5ce6-4a03-8577-616b13ee5d06 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:54:20.446581 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cf2aa695-5ce6-4a03-8577-616b13ee5d06 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:20.447024 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cf2aa695-5ce6-4a03-8577-616b13ee5d06 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:20.447856 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cf2aa695-5ce6-4a03-8577-616b13ee5d06 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:20.448375 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cf2aa695-5ce6-4a03-8577-616b13ee5d06 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:20.605873 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-cf2aa695-5ce6-4a03-8577-616b13ee5d06 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:54:20.614315 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-cf2aa695-5ce6-4a03-8577-616b13ee5d06 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 200 len: 1266 microversion: 2.1 time: 0.179849 Nov 23 07:54:20.614893 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 605/1153] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:54:20 2021] GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:54:21.631170 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-d3aa1adf-f743-4cae-a2c0-7cbf9d35e05c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:54:21.631824 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-d3aa1adf-f743-4cae-a2c0-7cbf9d35e05c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:54:21.638674 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d3aa1adf-f743-4cae-a2c0-7cbf9d35e05c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:21.639162 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d3aa1adf-f743-4cae-a2c0-7cbf9d35e05c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:21.640767 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d3aa1adf-f743-4cae-a2c0-7cbf9d35e05c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:21.641199 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-d3aa1adf-f743-4cae-a2c0-7cbf9d35e05c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:21.795500 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-d3aa1adf-f743-4cae-a2c0-7cbf9d35e05c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:54:21.803608 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-d3aa1adf-f743-4cae-a2c0-7cbf9d35e05c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 200 len: 1266 microversion: 2.1 time: 0.176154 Nov 23 07:54:21.804184 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 549/1154] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:54:21 2021] GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:54:22.820742 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-cfb68476-686a-429c-a9ed-9f417ccd046a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:54:22.821384 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-cfb68476-686a-429c-a9ed-9f417ccd046a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:54:22.828409 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cfb68476-686a-429c-a9ed-9f417ccd046a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:22.828861 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cfb68476-686a-429c-a9ed-9f417ccd046a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:22.829674 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cfb68476-686a-429c-a9ed-9f417ccd046a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:22.830106 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-cfb68476-686a-429c-a9ed-9f417ccd046a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:22.968609 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-cfb68476-686a-429c-a9ed-9f417ccd046a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:54:22.975959 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-cfb68476-686a-429c-a9ed-9f417ccd046a tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 200 len: 1266 microversion: 2.1 time: 0.158929 Nov 23 07:54:22.976520 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 606/1155] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:54:22 2021] GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:54:23.992884 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-233ec3f8-89c1-4cf9-abf8-1757ac95c44b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:54:23.993494 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-233ec3f8-89c1-4cf9-abf8-1757ac95c44b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:54:24.000217 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-233ec3f8-89c1-4cf9-abf8-1757ac95c44b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:24.000650 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-233ec3f8-89c1-4cf9-abf8-1757ac95c44b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:24.001454 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-233ec3f8-89c1-4cf9-abf8-1757ac95c44b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:24.001916 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-233ec3f8-89c1-4cf9-abf8-1757ac95c44b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:24.147748 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-233ec3f8-89c1-4cf9-abf8-1757ac95c44b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:54:24.155362 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-233ec3f8-89c1-4cf9-abf8-1757ac95c44b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 200 len: 1266 microversion: 2.1 time: 0.166243 Nov 23 07:54:24.156662 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 550/1156] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:54:23 2021] GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:54:25.172930 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-0dde149b-6b56-4a3b-b678-2d1c5a010b96 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:54:25.173473 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-0dde149b-6b56-4a3b-b678-2d1c5a010b96 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:54:25.179694 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0dde149b-6b56-4a3b-b678-2d1c5a010b96 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:25.180144 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0dde149b-6b56-4a3b-b678-2d1c5a010b96 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:25.180917 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0dde149b-6b56-4a3b-b678-2d1c5a010b96 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:25.181359 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0dde149b-6b56-4a3b-b678-2d1c5a010b96 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:25.313037 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-0dde149b-6b56-4a3b-b678-2d1c5a010b96 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:54:25.320338 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-0dde149b-6b56-4a3b-b678-2d1c5a010b96 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 200 len: 1266 microversion: 2.1 time: 0.151812 Nov 23 07:54:25.320890 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 607/1157] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:54:25 2021] GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:54:25.649455 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-f97a6b48-0d43-46c0-a27b-224b15e46083 req-33e8bad2-715d-4c44-8777-4255b8bc8da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c17bd508-168c-424a-bcf3-6145c780cc4a", "name": "network-vif-plugged", "status": "completed", "tag": "ea625575-2852-4b8b-940c-bec1d9c9bfb1"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:54:25.650963 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:54:25.650963 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:54:25.658604 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-f97a6b48-0d43-46c0-a27b-224b15e46083 req-33e8bad2-715d-4c44-8777-4255b8bc8da4 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:25.659038 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-f97a6b48-0d43-46c0-a27b-224b15e46083 req-33e8bad2-715d-4c44-8777-4255b8bc8da4 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:25.670222 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-f97a6b48-0d43-46c0-a27b-224b15e46083 req-33e8bad2-715d-4c44-8777-4255b8bc8da4 service nova] Creating event network-vif-plugged:ea625575-2852-4b8b-940c-bec1d9c9bfb1 for instance c17bd508-168c-424a-bcf3-6145c780cc4a on hv-cinder-80403 Nov 23 07:54:25.675213 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-f97a6b48-0d43-46c0-a27b-224b15e46083 req-33e8bad2-715d-4c44-8777-4255b8bc8da4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085171 Nov 23 07:54:25.675793 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 551/1158] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:54:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:54:26.336986 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-4b8db3eb-9971-40b7-807a-b1415f18bb4b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:54:26.337599 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-4b8db3eb-9971-40b7-807a-b1415f18bb4b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:54:26.343999 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4b8db3eb-9971-40b7-807a-b1415f18bb4b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:26.344453 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4b8db3eb-9971-40b7-807a-b1415f18bb4b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:26.345225 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4b8db3eb-9971-40b7-807a-b1415f18bb4b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:26.345662 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-4b8db3eb-9971-40b7-807a-b1415f18bb4b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:26.489656 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-4b8db3eb-9971-40b7-807a-b1415f18bb4b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:54:26.496826 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-4b8db3eb-9971-40b7-807a-b1415f18bb4b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 200 len: 1266 microversion: 2.1 time: 0.163605 Nov 23 07:54:26.497384 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 608/1159] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:54:26 2021] GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:54:27.514839 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-5caccc45-aa40-48be-a72a-4fdad059ec79 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:54:27.516102 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-5caccc45-aa40-48be-a72a-4fdad059ec79 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:54:27.522290 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5caccc45-aa40-48be-a72a-4fdad059ec79 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:27.522734 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5caccc45-aa40-48be-a72a-4fdad059ec79 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:27.523498 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5caccc45-aa40-48be-a72a-4fdad059ec79 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:27.523927 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-5caccc45-aa40-48be-a72a-4fdad059ec79 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:27.656518 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-5caccc45-aa40-48be-a72a-4fdad059ec79 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:54:27.664131 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-5caccc45-aa40-48be-a72a-4fdad059ec79 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 200 len: 1453 microversion: 2.1 time: 0.153757 Nov 23 07:54:27.664712 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 552/1160] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:54:27 2021] GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:54:27.679767 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-3d13c1e8-e9fc-411a-a34b-364aabdcabda tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:54:27.680366 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-3d13c1e8-e9fc-411a-a34b-364aabdcabda tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:54:27.686489 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3d13c1e8-e9fc-411a-a34b-364aabdcabda tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:27.687475 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3d13c1e8-e9fc-411a-a34b-364aabdcabda tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:27.688254 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3d13c1e8-e9fc-411a-a34b-364aabdcabda tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:27.688688 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-3d13c1e8-e9fc-411a-a34b-364aabdcabda tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:27.822925 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-3d13c1e8-e9fc-411a-a34b-364aabdcabda tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:54:27.830349 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-3d13c1e8-e9fc-411a-a34b-364aabdcabda tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 200 len: 1453 microversion: 2.1 time: 0.154206 Nov 23 07:54:27.830914 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 609/1161] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:54:27 2021] GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:54:29.705402 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-86593660-bb1a-401a-9870-60ee5a757dde req-994442d1-534d-4bf7-b0b9-6eb88ff4b8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c17bd508-168c-424a-bcf3-6145c780cc4a", "tag": "ea625575-2852-4b8b-940c-bec1d9c9bfb1"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:54:29.706930 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:54:29.706930 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:54:29.713659 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-86593660-bb1a-401a-9870-60ee5a757dde req-994442d1-534d-4bf7-b0b9-6eb88ff4b8e4 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:54:29.714137 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-86593660-bb1a-401a-9870-60ee5a757dde req-994442d1-534d-4bf7-b0b9-6eb88ff4b8e4 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:54:29.725530 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-86593660-bb1a-401a-9870-60ee5a757dde req-994442d1-534d-4bf7-b0b9-6eb88ff4b8e4 service nova] Creating event network-changed:ea625575-2852-4b8b-940c-bec1d9c9bfb1 for instance c17bd508-168c-424a-bcf3-6145c780cc4a on hv-cinder-80403 Nov 23 07:54:29.730524 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-86593660-bb1a-401a-9870-60ee5a757dde req-994442d1-534d-4bf7-b0b9-6eb88ff4b8e4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085121 Nov 23 07:54:29.731292 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 553/1162] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:54:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:54:43.344938 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 07:54:43.345572 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: Tue Nov 23 07:54:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 07:54:56.407713 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 07:54:56.408601 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: Tue Nov 23 07:54:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 07:56:07.461795 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-af39253f-3ff9-4cf8-9240-5370491f3bd3 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:56:07.462432 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-af39253f-3ff9-4cf8-9240-5370491f3bd3 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:56:07.465524 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-589ea6a8-3019-4d34-a7ff-7152cca0d2e6 req-5fb73a46-5698-4ac5-850b-e8665654c433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c17bd508-168c-424a-bcf3-6145c780cc4a", "tag": "ea625575-2852-4b8b-940c-bec1d9c9bfb1"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:56:07.467009 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:56:07.467009 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:56:07.469581 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-af39253f-3ff9-4cf8-9240-5370491f3bd3 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:07.470317 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-af39253f-3ff9-4cf8-9240-5370491f3bd3 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:07.471331 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-af39253f-3ff9-4cf8-9240-5370491f3bd3 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:07.471775 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-af39253f-3ff9-4cf8-9240-5370491f3bd3 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:07.475005 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-589ea6a8-3019-4d34-a7ff-7152cca0d2e6 req-5fb73a46-5698-4ac5-850b-e8665654c433 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:07.475672 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-589ea6a8-3019-4d34-a7ff-7152cca0d2e6 req-5fb73a46-5698-4ac5-850b-e8665654c433 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:07.487625 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-589ea6a8-3019-4d34-a7ff-7152cca0d2e6 req-5fb73a46-5698-4ac5-850b-e8665654c433 service nova] Creating event network-changed:ea625575-2852-4b8b-940c-bec1d9c9bfb1 for instance c17bd508-168c-424a-bcf3-6145c780cc4a on hv-cinder-80403 Nov 23 07:56:07.494305 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-589ea6a8-3019-4d34-a7ff-7152cca0d2e6 req-5fb73a46-5698-4ac5-850b-e8665654c433 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033532 Nov 23 07:56:07.495221 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 554/1163] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:56:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:56:07.498074 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-af39253f-3ff9-4cf8-9240-5370491f3bd3 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Going to try to terminate instance {{(pid=122786) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:56:07.587819 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-af39253f-3ff9-4cf8-9240-5370491f3bd3 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 204 len: 0 microversion: 2.1 time: 0.130482 Nov 23 07:56:07.588708 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 610/1164] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:56:07 2021] DELETE /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 07:56:07.598024 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-115f29d8-008b-45eb-b7c2-73090fe24062 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:56:07.598816 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-115f29d8-008b-45eb-b7c2-73090fe24062 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:56:07.607726 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-115f29d8-008b-45eb-b7c2-73090fe24062 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:07.608259 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-115f29d8-008b-45eb-b7c2-73090fe24062 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:07.609718 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-115f29d8-008b-45eb-b7c2-73090fe24062 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:07.610452 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-115f29d8-008b-45eb-b7c2-73090fe24062 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:07.847265 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-115f29d8-008b-45eb-b7c2-73090fe24062 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:56:07.855593 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-115f29d8-008b-45eb-b7c2-73090fe24062 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 200 len: 1578 microversion: 2.1 time: 0.261611 Nov 23 07:56:07.856242 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 555/1165] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:56:07 2021] GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 1578 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:56:08.875625 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ef942a6d-0195-4305-a9d2-c0de50ee8468 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:56:08.876234 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ef942a6d-0195-4305-a9d2-c0de50ee8468 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:56:08.883148 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ef942a6d-0195-4305-a9d2-c0de50ee8468 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:08.883596 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ef942a6d-0195-4305-a9d2-c0de50ee8468 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:08.884367 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ef942a6d-0195-4305-a9d2-c0de50ee8468 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:08.884795 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ef942a6d-0195-4305-a9d2-c0de50ee8468 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:09.017873 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ef942a6d-0195-4305-a9d2-c0de50ee8468 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:56:09.025068 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ef942a6d-0195-4305-a9d2-c0de50ee8468 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 200 len: 1459 microversion: 2.1 time: 0.153599 Nov 23 07:56:09.025616 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 611/1166] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:56:08 2021] GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 1459 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:56:09.982446 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-9133db7e-29fb-48ad-a03c-eb74d8619cc4 req-23db5635-f47d-4f6a-a3da-95218220b517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c17bd508-168c-424a-bcf3-6145c780cc4a", "name": "network-vif-deleted", "tag": "ea625575-2852-4b8b-940c-bec1d9c9bfb1"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:56:09.983993 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:56:09.983993 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:56:09.991258 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-9133db7e-29fb-48ad-a03c-eb74d8619cc4 req-23db5635-f47d-4f6a-a3da-95218220b517 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:09.991708 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-9133db7e-29fb-48ad-a03c-eb74d8619cc4 req-23db5635-f47d-4f6a-a3da-95218220b517 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:10.002609 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-9133db7e-29fb-48ad-a03c-eb74d8619cc4 req-23db5635-f47d-4f6a-a3da-95218220b517 service nova] Creating event network-vif-deleted:ea625575-2852-4b8b-940c-bec1d9c9bfb1 for instance c17bd508-168c-424a-bcf3-6145c780cc4a on hv-cinder-80403 Nov 23 07:56:10.008158 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-9133db7e-29fb-48ad-a03c-eb74d8619cc4 req-23db5635-f47d-4f6a-a3da-95218220b517 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028836 Nov 23 07:56:10.008740 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 556/1167] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:56:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:56:10.042155 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-95a94817-3a18-417f-bd24-55cad28b0282 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:56:10.042762 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-95a94817-3a18-417f-bd24-55cad28b0282 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:56:10.048694 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-95a94817-3a18-417f-bd24-55cad28b0282 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:10.049139 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-95a94817-3a18-417f-bd24-55cad28b0282 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:10.049954 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-95a94817-3a18-417f-bd24-55cad28b0282 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:10.050394 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-95a94817-3a18-417f-bd24-55cad28b0282 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:10.109782 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-95a94817-3a18-417f-bd24-55cad28b0282 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:56:10.117007 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-95a94817-3a18-417f-bd24-55cad28b0282 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 200 len: 1225 microversion: 2.1 time: 0.078569 Nov 23 07:56:10.117580 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 612/1168] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:56:10 2021] GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:56:11.134596 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-822e75d5-557a-4aa9-abc0-e35dddd508ea tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:56:11.135327 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-822e75d5-557a-4aa9-abc0-e35dddd508ea tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: c17bd508-168c-424a-bcf3-6145c780cc4a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:56:11.141523 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-822e75d5-557a-4aa9-abc0-e35dddd508ea tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:11.141996 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-822e75d5-557a-4aa9-abc0-e35dddd508ea tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:11.142779 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-822e75d5-557a-4aa9-abc0-e35dddd508ea tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:11.143214 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-822e75d5-557a-4aa9-abc0-e35dddd508ea tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:11.156727 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-822e75d5-557a-4aa9-abc0-e35dddd508ea tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] HTTP exception thrown: Instance c17bd508-168c-424a-bcf3-6145c780cc4a could not be found. Nov 23 07:56:11.157577 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-822e75d5-557a-4aa9-abc0-e35dddd508ea tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Returning 404 to user: Instance c17bd508-168c-424a-bcf3-6145c780cc4a could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:56:11.158422 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-822e75d5-557a-4aa9-abc0-e35dddd508ea tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a" status: 404 len: 111 microversion: 2.1 time: 0.028492 Nov 23 07:56:11.158951 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 557/1169] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:56:11 2021] GET /compute/v2.1/servers/c17bd508-168c-424a-bcf3-6145c780cc4a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:56:14.489748 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-f0733f55-2416-46ae-b9b4-75fdfc7d6b1b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:56:14.490423 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f0733f55-2416-46ae-b9b4-75fdfc7d6b1b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:56:14.491446 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-cf9ac7b0-7ed2-4f7b-8da4-b82f3d1d8ed1 req-e728cf9f-7d19-435e-9e17-16c4a17ddf28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18f5dd9-65e2-499f-94d9-4d2b8a657e1a", "tag": "9e3b2c21-6496-4e46-b7a3-80855a393bc3"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:56:14.493579 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:56:14.493579 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:56:14.497151 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f0733f55-2416-46ae-b9b4-75fdfc7d6b1b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:14.497604 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f0733f55-2416-46ae-b9b4-75fdfc7d6b1b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:14.498440 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f0733f55-2416-46ae-b9b4-75fdfc7d6b1b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:14.499027 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-f0733f55-2416-46ae-b9b4-75fdfc7d6b1b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:14.502298 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-cf9ac7b0-7ed2-4f7b-8da4-b82f3d1d8ed1 req-e728cf9f-7d19-435e-9e17-16c4a17ddf28 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:14.502747 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-cf9ac7b0-7ed2-4f7b-8da4-b82f3d1d8ed1 req-e728cf9f-7d19-435e-9e17-16c4a17ddf28 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:14.513806 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-cf9ac7b0-7ed2-4f7b-8da4-b82f3d1d8ed1 req-e728cf9f-7d19-435e-9e17-16c4a17ddf28 service nova] Creating event network-changed:9e3b2c21-6496-4e46-b7a3-80855a393bc3 for instance e18f5dd9-65e2-499f-94d9-4d2b8a657e1a on hv-cinder-80403 Nov 23 07:56:14.519048 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-cf9ac7b0-7ed2-4f7b-8da4-b82f3d1d8ed1 req-e728cf9f-7d19-435e-9e17-16c4a17ddf28 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031132 Nov 23 07:56:14.519866 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 558/1170] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:56:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 07:56:14.526762 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-f0733f55-2416-46ae-b9b4-75fdfc7d6b1b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Going to try to terminate instance {{(pid=122786) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 07:56:14.612087 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-f0733f55-2416-46ae-b9b4-75fdfc7d6b1b tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 204 len: 0 microversion: 2.1 time: 0.126390 Nov 23 07:56:14.612777 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 613/1171] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:56:14 2021] DELETE /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 07:56:14.621901 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-00cf5974-4756-412a-b38f-73b20af10cfa tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:56:14.622732 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-00cf5974-4756-412a-b38f-73b20af10cfa tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:56:14.629044 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-00cf5974-4756-412a-b38f-73b20af10cfa tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:14.629590 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-00cf5974-4756-412a-b38f-73b20af10cfa tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:14.630460 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-00cf5974-4756-412a-b38f-73b20af10cfa tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:14.631136 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-00cf5974-4756-412a-b38f-73b20af10cfa tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:14.878891 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.policy [None req-00cf5974-4756-412a-b38f-73b20af10cfa tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122785) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:56:14.886958 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-00cf5974-4756-412a-b38f-73b20af10cfa tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 200 len: 1576 microversion: 2.1 time: 0.269687 Nov 23 07:56:14.887533 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 559/1172] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:56:14 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 1576 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 07:56:15.904517 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-d11ce94d-6b60-42b1-bf2a-e82699732b33 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:56:15.905205 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-d11ce94d-6b60-42b1-bf2a-e82699732b33 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:56:15.911667 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d11ce94d-6b60-42b1-bf2a-e82699732b33 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:15.912109 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d11ce94d-6b60-42b1-bf2a-e82699732b33 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:15.912872 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d11ce94d-6b60-42b1-bf2a-e82699732b33 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:15.913303 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-d11ce94d-6b60-42b1-bf2a-e82699732b33 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:16.044202 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-d11ce94d-6b60-42b1-bf2a-e82699732b33 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:56:16.051822 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-d11ce94d-6b60-42b1-bf2a-e82699732b33 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 200 len: 1457 microversion: 2.1 time: 0.151287 Nov 23 07:56:16.052396 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 614/1173] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:56:15 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 1457 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:56:16.876376 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [req-84728017-005f-475a-ba24-43ef15d4fed8 req-8594cb37-04ac-4fb7-88ad-49a42643c297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18f5dd9-65e2-499f-94d9-4d2b8a657e1a", "name": "network-vif-deleted", "tag": "9e3b2c21-6496-4e46-b7a3-80855a393bc3"}]} {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 07:56:16.878324 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 07:56:16.878324 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: warnings.warn(msg) Nov 23 07:56:16.888589 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-84728017-005f-475a-ba24-43ef15d4fed8 req-8594cb37-04ac-4fb7-88ad-49a42643c297 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:16.889031 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [req-84728017-005f-475a-ba24-43ef15d4fed8 req-8594cb37-04ac-4fb7-88ad-49a42643c297 service nova] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:16.901196 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.compute.server_external_events [req-84728017-005f-475a-ba24-43ef15d4fed8 req-8594cb37-04ac-4fb7-88ad-49a42643c297 service nova] Creating event network-vif-deleted:9e3b2c21-6496-4e46-b7a3-80855a393bc3 for instance e18f5dd9-65e2-499f-94d9-4d2b8a657e1a on hv-cinder-80403 Nov 23 07:56:16.907751 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [req-84728017-005f-475a-ba24-43ef15d4fed8 req-8594cb37-04ac-4fb7-88ad-49a42643c297 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034559 Nov 23 07:56:16.908355 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 560/1174] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Nov 23 07:56:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 07:56:17.069025 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-ad724a50-627f-45dc-a0fb-83f6ccc961da tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:56:17.069798 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-ad724a50-627f-45dc-a0fb-83f6ccc961da tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:56:17.077493 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ad724a50-627f-45dc-a0fb-83f6ccc961da tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:17.077974 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ad724a50-627f-45dc-a0fb-83f6ccc961da tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:17.079148 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ad724a50-627f-45dc-a0fb-83f6ccc961da tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:17.079148 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-ad724a50-627f-45dc-a0fb-83f6ccc961da tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:17.139816 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.policy [None req-ad724a50-627f-45dc-a0fb-83f6ccc961da tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb14b561f25411684be4c930e712800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923ced17fbea41d2bb472b52dd316477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122786) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 07:56:17.147324 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-ad724a50-627f-45dc-a0fb-83f6ccc961da tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 200 len: 1224 microversion: 2.1 time: 0.081919 Nov 23 07:56:17.148225 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 615/1175] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:56:17 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 07:56:18.165119 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c3bb3c35-b407-4f0b-85de-14e3fec2c782 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:56:18.165827 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-c3bb3c35-b407-4f0b-85de-14e3fec2c782 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: e18f5dd9-65e2-499f-94d9-4d2b8a657e1a] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:56:18.171926 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c3bb3c35-b407-4f0b-85de-14e3fec2c782 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:18.172368 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c3bb3c35-b407-4f0b-85de-14e3fec2c782 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:18.173133 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c3bb3c35-b407-4f0b-85de-14e3fec2c782 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:18.173556 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-c3bb3c35-b407-4f0b-85de-14e3fec2c782 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:18.186502 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-c3bb3c35-b407-4f0b-85de-14e3fec2c782 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] HTTP exception thrown: Instance e18f5dd9-65e2-499f-94d9-4d2b8a657e1a could not be found. Nov 23 07:56:18.187086 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-c3bb3c35-b407-4f0b-85de-14e3fec2c782 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Returning 404 to user: Instance e18f5dd9-65e2-499f-94d9-4d2b8a657e1a could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:56:18.187907 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-c3bb3c35-b407-4f0b-85de-14e3fec2c782 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a" status: 404 len: 111 microversion: 2.1 time: 0.026983 Nov 23 07:56:18.188432 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 561/1176] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:56:18 2021] GET /compute/v2.1/servers/e18f5dd9-65e2-499f-94d9-4d2b8a657e1a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:56:18.630873 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-0c3b7236-95ec-4d62-9dff-78e0b2b6ee96 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:56:18.634998 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.compute.api [None req-0c3b7236-95ec-4d62-9dff-78e0b2b6ee96 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122786) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:56:18.641401 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0c3b7236-95ec-4d62-9dff-78e0b2b6ee96 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:18.641873 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0c3b7236-95ec-4d62-9dff-78e0b2b6ee96 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:18.642668 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0c3b7236-95ec-4d62-9dff-78e0b2b6ee96 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:18.643102 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG oslo_concurrency.lockutils [None req-0c3b7236-95ec-4d62-9dff-78e0b2b6ee96 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:18.661469 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.wsgi [None req-0c3b7236-95ec-4d62-9dff-78e0b2b6ee96 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] HTTP exception thrown: Instance 9e6c04f8-01f0-44e2-9232-f865f1af5591 could not be found. Nov 23 07:56:18.662010 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-0c3b7236-95ec-4d62-9dff-78e0b2b6ee96 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Returning 404 to user: Instance 9e6c04f8-01f0-44e2-9232-f865f1af5591 could not be found. {{(pid=122786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:56:18.662843 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-0c3b7236-95ec-4d62-9dff-78e0b2b6ee96 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 404 len: 111 microversion: 2.1 time: 0.035728 Nov 23 07:56:18.663406 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 616/1177] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Nov 23 07:56:18 2021] DELETE /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 07:56:18.673028 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-1d01e090-973e-4b7a-b9ab-63996f2b688c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '>' {{(pid=122785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:56:18.673625 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.compute.api [None req-1d01e090-973e-4b7a-b9ab-63996f2b688c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [instance: 9e6c04f8-01f0-44e2-9232-f865f1af5591] Fetching instance by UUID {{(pid=122785) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 07:56:18.680503 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1d01e090-973e-4b7a-b9ab-63996f2b688c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:18.680942 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1d01e090-973e-4b7a-b9ab-63996f2b688c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:18.681722 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1d01e090-973e-4b7a-b9ab-63996f2b688c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 07:56:18.682156 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG oslo_concurrency.lockutils [None req-1d01e090-973e-4b7a-b9ab-63996f2b688c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Lock "00cd383d-2cfa-4558-9f64-d93e8a76ade1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 07:56:18.696969 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.wsgi [None req-1d01e090-973e-4b7a-b9ab-63996f2b688c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] HTTP exception thrown: Instance 9e6c04f8-01f0-44e2-9232-f865f1af5591 could not be found. Nov 23 07:56:18.697558 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: DEBUG nova.api.openstack.wsgi [None req-1d01e090-973e-4b7a-b9ab-63996f2b688c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Returning 404 to user: Instance 9e6c04f8-01f0-44e2-9232-f865f1af5591 could not be found. {{(pid=122785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 07:56:18.698412 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO nova.api.openstack.requestlog [None req-1d01e090-973e-4b7a-b9ab-63996f2b688c tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591" status: 404 len: 111 microversion: 2.1 time: 0.029459 Nov 23 07:56:18.698959 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: [pid: 122785|app: 0|req: 562/1178] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Nov 23 07:56:18 2021] GET /compute/v2.1/servers/9e6c04f8-01f0-44e2-9232-f865f1af5591 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 07:56:19.986034 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: DEBUG nova.api.openstack.wsgi [None req-1fbc0780-cc21-42b7-985e-d00542533b59 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] Calling method '.version_select at 0x7f05146b43a0>' {{(pid=122786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 07:56:19.989492 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1fbc0780-cc21-42b7-985e-d00542533b59 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [8cdf7e0c-7859-474f-b725-2733b517cdb6] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 23 07:56:21.006514 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO oslo.messaging._drivers.impl_rabbit [None req-1fbc0780-cc21-42b7-985e-d00542533b59 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] [8cdf7e0c-7859-474f-b725-2733b517cdb6] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 46554. Nov 23 07:56:21.028240 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO nova.api.openstack.requestlog [None req-1fbc0780-cc21-42b7-985e-d00542533b59 tempest-TestVolumeBootPattern-1709268154 tempest-TestVolumeBootPattern-1709268154-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-592728128" status: 202 len: 0 microversion: 2.1 time: 1.046162 Nov 23 07:56:21.029634 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: [pid: 122786|app: 0|req: 617/1179] 10.222.0.48 () {58 vars in 1259 bytes} [Tue Nov 23 07:56:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-592728128 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 07:58:03.363868 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 07:58:03.364620 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: Tue Nov 23 07:58:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 07:58:16.428934 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 07:58:16.429537 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: Tue Nov 23 07:58:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 07:58:20.221902 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 07:58:20.222569 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: Tue Nov 23 07:58:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 07:58:34.010016 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 07:58:34.010614 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: Tue Nov 23 07:58:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 08:00:06.432422 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 08:00:06.433156 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: Tue Nov 23 08:00:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 08:01:23.381380 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 08:01:23.382017 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: Tue Nov 23 08:01:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 08:01:29.761665 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 08:01:29.762328 dv-cinder-804035-14-iscsi devstack@n-api.service[122786]: Tue Nov 23 08:01:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 08:01:36.446395 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 08:01:36.446954 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: Tue Nov 23 08:01:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 08:01:40.240185 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 08:01:40.240914 dv-cinder-804035-14-iscsi devstack@n-api.service[122785]: Tue Nov 23 08:01:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!